Apr 24 01:02:22 devstack cinder-volume[72228]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 01:02:22 devstack cinder-volume[72228]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 01:02:22 devstack cinder-volume[72228]: we strongly recommend against using it for new projects. Apr 24 01:02:22 devstack cinder-volume[72228]: If you are already using Eventlet, we recommend migrating to a different Apr 24 01:02:22 devstack cinder-volume[72228]: framework. For more detail see Apr 24 01:02:22 devstack cinder-volume[72228]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 01:02:22 devstack cinder-volume[72228]: import eventlet # noqa Apr 24 01:02:24 devstack cinder-volume[72228]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 01:02:24 devstack cinder-volume[72228]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 01:02:24 devstack cinder-volume[72228]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 01:02:25 devstack cinder-volume[72228]: INFO dbcounter [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Registered counter for database cinder Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_db.sqlalchemy.engines [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG dbcounter [-] [72228] Writer thread running {{(pid=72228) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 01:02:25 devstack cinder-volume[72228]: INFO cinder.rpc [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 01:02:25 devstack cinder-volume[72228]: INFO cinder.rpc [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_db.sqlalchemy.engines [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:02:25 devstack cinder-volume[72228]: INFO cinder.volume.manager [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Determined volume DB was empty at startup. Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG cinder.volume.manager [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72228) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 01:02:25 devstack cinder-volume[72228]: INFO cinder.volume.manager [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 01:02:25 devstack cinder-volume[72228]: WARNING stevedore.named [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 01:02:25 devstack cinder-volume[72228]: WARNING castellan.key_manager [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 01:02:25 devstack cinder-volume[72228]: WARNING cinder.keymgr.conf_key_mgr [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG cinder.volume.drivers.lvm [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72228) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_concurrency.processutils [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72228) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_concurrency.processutils [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] CMD "cinder-rtstool verify" returned: 0 in 0.274s {{(pid=72228) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_db.sqlalchemy.engines [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:02:25 devstack cinder-volume[72228]: INFO cinder.rpc [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 24 01:02:25 devstack cinder-volume[72228]: INFO cinder.rpc [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 24 01:02:25 devstack cinder-volume[72228]: WARNING stevedore.named [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 01:02:25 devstack cinder-volume[72228]: WARNING castellan.key_manager [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 01:02:25 devstack cinder-volume[72228]: INFO cinder.volume.manager [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_db.sqlalchemy.engines [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:02:25 devstack cinder-volume[72228]: INFO oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Starting 1 workers Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Started child 72332 {{(pid=72228) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Full set of CONF: {{(pid=72228) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] ******************************************************************************** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Configuration options gathered from: {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 01:02:25 devstack cinder-volume[72332]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 01:02:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] ================================================================================ {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] allow_availability_zone_fallback = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] allow_compression_on_image_upload = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] allowed_direct_url_schemes = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] api_rate_limit = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] auth_strategy = keystone {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] az_cache_duration = 3600 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_availability_zone = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_host = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_stats_polling_interval = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backup_api_class = cinder.backup.api.API {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backup_name_template = backup-%s {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backup_use_same_host = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backup_use_temp_snapshot = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] chap_password = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] chap_username = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_internal_tenant_project_id = c28bde0c11974ffc92e3cea72cff631a {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_internal_tenant_user_id = 8c46656ebaf8492d8e371f2940265774 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cloned_volume_same_az = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cluster = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] compression_format = gzip {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] compute_api_class = cinder.compute.nova.API {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] config_dir = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] config_source = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] control_exchange = openstack {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] debug = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] default_availability_zone = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] default_group_type = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] default_volume_type = lvmdriver-1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] disk_geometry = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] driver_client_cert = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] driver_client_cert_key = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] driver_data_namespace = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] driver_ssl_cert_path = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] driver_ssl_cert_verify = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] driver_use_ssl = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] enable_force_upload = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] enable_new_services = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] enable_unsupported_driver = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] enforce_multipath_for_image_xfer = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] filter_function = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_api_insecure = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_api_servers = ['http://192.168.122.180/image'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_api_ssl_compression = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72332]: INFO cinder.volume.manager [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_ca_certificates_file = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_catalog_info = image:glance:publicURL {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_certfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_keyfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_num_retries = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance_request_timeout = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] goodness_function = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] graceful_shutdown_timeout = 5 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] group_api_class = cinder.group.api.API {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] host = devstack {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_compress_on_upload = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_conversion_address_space_limit = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_conversion_cpu_limit = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_conversion_disable = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_upload_use_cinder_backend = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_upload_use_internal_tenant = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_volume_cache_enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_volume_cache_max_count = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] image_volume_cache_max_size_gb = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] init_host_max_objects_retrieval = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] instance_format = [instance: %(uuid)s] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] iscsi_target_flags = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] iscsi_write_cache = on {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] iser_helper = tgtadm {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] iser_ip_address = 192.168.122.180 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] iser_port = 3260 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_color = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_config_append = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_dir = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_file = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_options = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_rotate_interval = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_rotate_interval_type = days {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] log_rotation_type = none {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] max_age = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] max_logfile_count = 30 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] max_logfile_size_mb = 200 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] max_over_subscription_ratio = 20.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] message_reap_interval = 86400 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] message_ttl = 2592000 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] migration_create_volume_timeout_secs = 300 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] monkey_patch = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] monkey_patch_modules = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] my_ip = 192.168.122.180 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] no_snapshot_gb_quota = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] num_iser_scan_tries = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] num_shell_tries = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] num_volume_device_scan_tries = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] nvmeof_conn_info_version = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] nvmet_ns_id = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] nvmet_port_id = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] osapi_max_limit = 1000 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] osapi_volume_ext_list = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] osapi_volume_listen_port = 8776 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] osapi_volume_use_ssl = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] osapi_volume_workers = 2 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] per_volume_size_limit = -1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] periodic_fuzzy_delay = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] periodic_interval = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] public_endpoint = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] publish_errors = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] quota_backup_gigabytes = 1000 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] quota_backups = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] quota_gigabytes = 1000 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] quota_groups = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] quota_snapshots = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] quota_volumes = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] rate_limit_burst = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] rate_limit_except_level = CRITICAL {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] rate_limit_interval = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] reinit_driver_count = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] replication_device = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] report_discard_supported = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] report_interval = 120 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] reservation_clean_interval = 86400 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] reservation_expire = 86400 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] reserved_image_namespaces = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] reserved_percentage = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] rpc_response_timeout = 120 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] run_external_periodic_tasks = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] scst_target_driver = iscsi {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] scst_target_iqn_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_down_time = 720 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] shell_completion = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] snapshot_name_template = snapshot-%s {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] snapshot_same_host = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] split_loggers = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] state_path = /opt/stack/data/cinder {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] storage_availability_zone = nova {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] storage_protocol = iSCSI {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] syslog_log_facility = LOG_USER {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] target_helper = lioadm {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] target_ip_address = 192.168.122.180 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] target_port = 3260 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] target_protocol = iscsi {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] target_secondary_ip_addresses = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] trace_flags = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] transport_url = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] until_refresh = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] use_chap_auth = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] use_default_quota_class = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] use_journal = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] use_json = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] use_multipath_for_image_xfer = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] use_stderr = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] use_syslog = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] verify_glance_signatures = enabled {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_api_class = cinder.volume.api.API {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_backend_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_clear = zero {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_clear_ionice = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_clear_size = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_copy_bps_limit = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_dd_blocksize = 1M {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_name_template = volume-%s {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_service_inithost_offload = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volume_usage_audit_period = month {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] zoning_mode = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_concurrency.disable_process_locking = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.admin_password = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.admin_token = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.admin_user = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.auth_port = 35357 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.auth_protocol = https {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.auth_section = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.auth_type = password {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.auth_uri = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.auth_version = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.cache = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.certfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.identity_uri = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.include_service_catalog = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.insecure = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.interface = public {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.keyfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_password = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcache_username = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.region_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.service_type = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.backend = dogpile.cache.null {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.backend_argument = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.backend_expiration_time = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.config_prefix = cache.oslo {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.debug_cache_backend = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.enable_retry_client = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.enable_socket_keepalive = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.enforce_fips_mode = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.expiration_time = 600 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.hashclient_retry_attempts = 2 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.memcache_dead_retry = 300 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.memcache_pool_maxsize = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.memcache_sasl_enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.password = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.proxies = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.redis_db = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.redis_server = localhost:6379 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.retry_attempts = 2 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.retry_delay = 0.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.socket_keepalive_count = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.socket_keepalive_idle = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.socket_keepalive_interval = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.socket_timeout = 1.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.tls_allowed_ciphers = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.tls_cafile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.tls_certfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.tls_enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.tls_keyfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cache.username = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] coordination.backend_url = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.asyncio_connection = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.asyncio_slave_connection = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.backend = sqlalchemy {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.connection = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.connection_debug = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.connection_parameters = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.connection_recycle_time = 3600 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.connection_trace = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.db_inc_retry_interval = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.db_max_retries = 20 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.db_max_retry_interval = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.db_retry_interval = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.max_overflow = 50 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.max_pool_size = 5 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.max_retries = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.mysql_wsrep_sync_wait = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.pool_timeout = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.retry_interval = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.slave_connection = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.sqlite_synchronous = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.synchronous_reader = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] database.use_db_reconnect = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.connection_string = messaging:// {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.es_doc_type = notification {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.es_scroll_size = 10000 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.es_scroll_time = 2m {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.filter_error_trace = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.hmac_keys = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.sentinel_service_name = mymaster {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.socket_timeout = 0.1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.trace_requests = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler.trace_sqlalchemy = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler_jaeger.process_tags = {} {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler_jaeger.service_name_prefix = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] profiler_otlp.service_name_prefix = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.enforce_new_defaults = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: WARNING oslo_config.cfg [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.enforce_scope = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.policy_default_rule = default {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.policy_file = policy.yaml {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] privsep_osbrick.group = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] privsep_osbrick.helper_command = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] privsep_osbrick.user = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_sys_admin.group = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_sys_admin.helper_command = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] cinder_sys_admin.user = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.auth_section = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.auth_type = password {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.cafile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.certfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.collect_timing = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.insecure = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.keyfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.send_service_user_token = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.split_loggers = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] service_user.timeout = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.auth_section = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.auth_type = password {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.certfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.collect_timing = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.insecure = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.keyfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.region_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.split_loggers = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] glance.timeout = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.backend_availability_zone = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.chap_password = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.chap_username = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.disk_geometry = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.driver_client_cert = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.driver_client_cert_key = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.driver_data_namespace = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.driver_use_ssl = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.extra_capabilities = {} {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.filter_function = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.goodness_function = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.iscsi_target_flags = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.iscsi_write_cache = on {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.iser_helper = tgtadm {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.iser_port = 3260 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.lvm_share_target = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.lvm_type = auto {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.num_shell_tries = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.replication_device = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.report_discard_supported = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.reserved_percentage = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.target_helper = tgtadm {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.target_port = 3260 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.target_protocol = iscsi {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.trace_flags = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.unique_fqdn_network = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.use_chap_auth = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_backend_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_clear = zero {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_clear_ionice = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_clear_size = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_reports.file_event_handler = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_reports.log_dir = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.backend_host = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.chap_password = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.chap_username = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.disk_geometry = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.driver_client_cert = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.extra_capabilities = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.filter_function = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.goodness_function = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack sudo[72342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.iser_helper = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.iser_ip_address = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.iser_port = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.lvm_share_target = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.lvm_type = auto {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.num_shell_tries = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack sudo[72342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.replication_device = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.report_discard_supported = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.reserved_percentage = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.scst_target_driver = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.storage_protocol = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.target_helper = lioadm {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.target_ip_address = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.target_port = 3260 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.trace_flags = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.use_chap_auth = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_clear = zero {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_clear_size = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] lvmdriver-1.volumes_dir = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.ssl = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_notifications.driver = [] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_notifications.retry = -1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] key_manager.fixed_key = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.barbican_api_version = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.barbican_endpoint = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.barbican_endpoint_type = public {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.barbican_region_name = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.cafile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.certfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.collect_timing = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.insecure = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.keyfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.number_of_retries = 60 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.retry_delay = 1 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.send_service_user_token = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.split_loggers = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.timeout = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.verify_ssl = True {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican.verify_ssl_path = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.auth_section = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.auth_type = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.cafile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.certfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.collect_timing = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.insecure = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.keyfile = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.split_loggers = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] barbican_service_user.timeout = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.approle_role_id = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.approle_secret_id = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.kv_mountpoint = secret {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.kv_path = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.kv_version = 2 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.namespace = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.root_token_id = **** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.ssl_ca_crt_file = None {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.timeout = 60.0 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.use_ssl = False {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:02:26 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] ******************************************************************************** {{(pid=72228) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 01:02:26 devstack sudo[72342]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:26 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:26 devstack sudo[72500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:26 devstack sudo[72500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:27 devstack sudo[72500]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.523s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:02:27 devstack cinder-volume[72332]: INFO cinder.brick.local_dev.lvm [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 24 01:02:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:27 devstack sudo[72676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:02:27 devstack sudo[72676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:27 devstack sudo[72676]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:27 devstack cinder-volume[72332]: DEBUG cinder.brick.local_dev.lvm [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72332) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 24 01:02:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:28 devstack sudo[72856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:28 devstack sudo[72856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:28 devstack sudo[72856]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:29 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.009s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:29 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:29 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:29 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:29 devstack sudo[72990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:29 devstack sudo[72990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:29 devstack sudo[72990]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:29 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.532s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:29 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:29 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:29 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:29 devstack sudo[73033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 24 01:02:29 devstack sudo[73033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:30 devstack sudo[73033]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:30 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.543s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:30 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:30 devstack sudo[73038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:02:30 devstack sudo[73038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:30 devstack sudo[73038]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:30 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:30 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:30 devstack sudo[73046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:02:30 devstack sudo[73046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:31 devstack sudo[73046]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:31 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:31 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:31 devstack sudo[73049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:02:31 devstack sudo[73049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:31 devstack sudo[73049]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:31 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.544s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:31 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:31 devstack sudo[73054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:31 devstack sudo[73054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:32 devstack sudo[73054]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:32 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.533s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:32 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:32 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:32 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:32 devstack sudo[73058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:32 devstack sudo[73058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:32 devstack sudo[73058]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:32 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.546s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:32 devstack cinder-volume[72332]: INFO cinder.volume.drivers.lvm [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 24 01:02:32 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:32 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:32 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:32 devstack sudo[73070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:32 devstack sudo[73070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:33 devstack sudo[73070]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:33 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:33 devstack cinder-volume[72332]: DEBUG cinder.volume.drivers.lvm [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Updating volume stats {{(pid=72332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 01:02:33 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:33 devstack sudo[73183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:02:33 devstack sudo[73183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:34 devstack sudo[73183]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:34 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:34 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:34 devstack sudo[73323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:02:34 devstack sudo[73323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:34 devstack sudo[73323]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:34 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:34 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:34 devstack sudo[73327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:34 devstack sudo[73327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:35 devstack sudo[73327]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:35 devstack sudo[73332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:02:35 devstack sudo[73332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:35 devstack sudo[73332]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:35 devstack cinder-volume[72332]: INFO cinder.volume.driver [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG cinder.volume.driver [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72332) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG oslo_db.sqlalchemy.engines [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72332) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG dbcounter [-] [72332] Writer thread running {{(pid=72332) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG cinder.db.sqlalchemy.api [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Building query based on filter {{(pid=72332) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG cinder.image.image_utils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72332) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 01:02:35 devstack cinder-volume[72332]: INFO cinder.keymgr.migration [None req-535c4160-9313-4116-b515-3a0fe0b275ca None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG cinder.volume.drivers.lvm [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Updating volume stats {{(pid=72332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 01:02:35 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:35 devstack sudo[73338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:02:35 devstack sudo[73338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:35 devstack cinder-volume[72228]: DEBUG dbcounter [-] [72228] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72228) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:02:36 devstack sudo[73338]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:36 devstack sudo[73342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:02:36 devstack sudo[73342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:36 devstack sudo[73342]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.537s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:36 devstack sudo[73347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:36 devstack sudo[73347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:37 devstack sudo[73347]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:37 devstack sudo[73354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:02:37 devstack sudo[73354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:37 devstack sudo[73354]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.524s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:37 devstack cinder-volume[72332]: DEBUG cinder.manager [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Notifying Schedulers of capabilities ... {{(pid=72332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:02:37 devstack cinder-volume[72332]: INFO cinder.volume.manager [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Driver initialization completed successfully. Apr 24 01:02:37 devstack cinder-volume[72332]: INFO cinder.manager [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Initiating service 2 cleanup Apr 24 01:02:37 devstack cinder-volume[72332]: INFO cinder.manager [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Service 2 cleanup completed. Apr 24 01:02:37 devstack cinder-volume[72332]: DEBUG cinder.service [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Creating RPC server for service cinder-volume {{(pid=72332) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 01:02:37 devstack cinder-volume[72332]: DEBUG cinder.service [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72332) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 01:02:38 devstack cinder-volume[72332]: INFO cinder.volume.manager [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 24 01:02:38 devstack cinder-volume[72332]: DEBUG cinder.volume.drivers.lvm [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Updating volume stats {{(pid=72332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 01:02:38 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:38 devstack sudo[73363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:02:38 devstack sudo[73363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:38 devstack sudo[73363]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:38 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.536s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:38 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:38 devstack sudo[73367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:02:38 devstack sudo[73367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:39 devstack sudo[73367]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:39 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:39 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:39 devstack sudo[73370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:02:39 devstack sudo[73370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:39 devstack sudo[73370]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:39 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:39 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:02:39 devstack sudo[73483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:02:39 devstack sudo[73483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:02:40 devstack sudo[73483]: pam_unix(sudo:session): session closed for user root Apr 24 01:02:40 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:02:40 devstack cinder-volume[72332]: INFO cinder.volume.manager [None req-8fced556-b1d9-4b26-b5c7-03240d6da9c0 None None] Driver post RPC initialization completed successfully. Apr 24 01:02:50 devstack cinder-volume[72332]: DEBUG dbcounter [-] [72332] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72332) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:02:50 devstack cinder-volume[72332]: DEBUG dbcounter [-] [72332] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72332) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:03:36 devstack cinder-volume[72332]: DEBUG oslo_service.periodic_task [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72332) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:03:36 devstack cinder-volume[72332]: DEBUG cinder.volume.drivers.lvm [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Updating volume stats {{(pid=72332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 01:03:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:03:36 devstack sudo[75686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:03:36 devstack sudo[75686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:03:36 devstack sudo[75686]: pam_unix(sudo:session): session closed for user root Apr 24 01:03:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:03:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:03:36 devstack sudo[75690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:03:36 devstack sudo[75690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:03:37 devstack sudo[75690]: pam_unix(sudo:session): session closed for user root Apr 24 01:03:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:03:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:03:37 devstack sudo[75696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:03:37 devstack sudo[75696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:03:37 devstack sudo[75696]: pam_unix(sudo:session): session closed for user root Apr 24 01:03:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.512s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:03:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:03:37 devstack sudo[75699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:03:37 devstack sudo[75699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:03:38 devstack sudo[75699]: pam_unix(sudo:session): session closed for user root Apr 24 01:03:38 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:03:38 devstack cinder-volume[72332]: DEBUG cinder.manager [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Notifying Schedulers of capabilities ... {{(pid=72332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:04:36 devstack cinder-volume[72332]: DEBUG oslo_service.periodic_task [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72332) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:04:36 devstack cinder-volume[72332]: DEBUG cinder.volume.drivers.lvm [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Updating volume stats {{(pid=72332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 01:04:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:04:36 devstack sudo[78467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:04:36 devstack sudo[78467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:04:36 devstack sudo[78467]: pam_unix(sudo:session): session closed for user root Apr 24 01:04:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:04:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:04:36 devstack sudo[78470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:04:36 devstack sudo[78470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:04:37 devstack sudo[78470]: pam_unix(sudo:session): session closed for user root Apr 24 01:04:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:04:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:04:37 devstack sudo[78474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:04:37 devstack sudo[78474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:04:37 devstack sudo[78474]: pam_unix(sudo:session): session closed for user root Apr 24 01:04:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:04:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:04:37 devstack sudo[78477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:04:37 devstack sudo[78477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:04:38 devstack sudo[78477]: pam_unix(sudo:session): session closed for user root Apr 24 01:04:38 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:04:38 devstack cinder-volume[72332]: DEBUG cinder.manager [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Notifying Schedulers of capabilities ... {{(pid=72332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:04:50 devstack cinder-volume[72332]: DEBUG dbcounter [-] [72332] Writing DB stats cinder:SELECT=1 {{(pid=72332) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:04:50 devstack cinder-volume[72332]: DEBUG dbcounter [-] [72332] Writing DB stats cinder:UPDATE=1 {{(pid=72332) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:05:36 devstack cinder-volume[72332]: DEBUG oslo_service.periodic_task [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72332) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:05:36 devstack cinder-volume[72332]: DEBUG cinder.volume.drivers.lvm [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Updating volume stats {{(pid=72332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 01:05:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:05:36 devstack sudo[80389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 01:05:36 devstack sudo[80389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:05:36 devstack sudo[80389]: pam_unix(sudo:session): session closed for user root Apr 24 01:05:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:05:36 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:05:36 devstack sudo[80406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:05:36 devstack sudo[80406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:05:37 devstack sudo[80406]: pam_unix(sudo:session): session closed for user root Apr 24 01:05:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:05:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:05:37 devstack sudo[80411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 01:05:37 devstack sudo[80411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:05:37 devstack sudo[80411]: pam_unix(sudo:session): session closed for user root Apr 24 01:05:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.570s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:05:37 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:05:37 devstack sudo[80415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 01:05:37 devstack sudo[80415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:05:38 devstack sudo[80415]: pam_unix(sudo:session): session closed for user root Apr 24 01:05:38 devstack cinder-volume[72332]: DEBUG oslo_concurrency.processutils [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=72332) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:05:38 devstack cinder-volume[72332]: DEBUG cinder.manager [None req-7529095f-9440-4ae7-8460-205cb636d81f None None] Notifying Schedulers of capabilities ... {{(pid=72332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:06:25 devstack cinder-volume[72228]: INFO oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Caught SIGTERM, stopping children Apr 24 01:06:25 devstack cinder-volume[72228]: DEBUG oslo_concurrency.lockutils [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Acquiring lock "singleton_lock" {{(pid=72228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 01:06:25 devstack cinder-volume[72228]: DEBUG oslo_concurrency.lockutils [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Acquired lock "singleton_lock" {{(pid=72228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 01:06:25 devstack cinder-volume[72228]: DEBUG oslo_concurrency.lockutils [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Releasing lock "singleton_lock" {{(pid=72228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 01:06:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Stop services. {{(pid=72228) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 01:06:25 devstack cinder-volume[72228]: DEBUG oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Killing children. {{(pid=72228) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 01:06:25 devstack cinder-volume[72228]: INFO oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Waiting on 1 children to exit Apr 24 01:06:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.lockutils [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Acquiring lock "singleton_lock" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 01:06:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.lockutils [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Acquired lock "singleton_lock" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 01:06:27 devstack cinder-volume[72332]: DEBUG oslo_concurrency.lockutils [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Releasing lock "singleton_lock" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 01:06:28 devstack cinder-volume[72332]: WARNING amqp [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 01:06:28 devstack cinder-volume[72332]: WARNING amqp [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 01:06:28 devstack cinder-volume[72228]: INFO oslo_service.backend._eventlet.service [None req-f463dc2c-3862-4d63-98cc-64e5547c0002 None None] Child 72332 exited with status 0 Apr 24 01:06:28 devstack cinder-volume[81318]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 01:06:28 devstack cinder-volume[81318]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 01:06:28 devstack cinder-volume[81318]: we strongly recommend against using it for new projects. Apr 24 01:06:28 devstack cinder-volume[81318]: If you are already using Eventlet, we recommend migrating to a different Apr 24 01:06:28 devstack cinder-volume[81318]: framework. For more detail see Apr 24 01:06:28 devstack cinder-volume[81318]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 01:06:28 devstack cinder-volume[81318]: import eventlet # noqa Apr 24 01:06:30 devstack cinder-volume[81318]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 01:06:30 devstack cinder-volume[81318]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 01:06:30 devstack cinder-volume[81318]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 01:06:31 devstack cinder-volume[81318]: INFO dbcounter [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Registered counter for database cinder Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_db.sqlalchemy.engines [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG dbcounter [-] [81318] Writer thread running {{(pid=81318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 01:06:31 devstack cinder-volume[81318]: INFO cinder.rpc [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 01:06:31 devstack cinder-volume[81318]: INFO cinder.rpc [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_db.sqlalchemy.engines [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:06:31 devstack cinder-volume[81318]: INFO cinder.volume.manager [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Determined volume DB was empty at startup. Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG cinder.volume.manager [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81318) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 01:06:31 devstack cinder-volume[81318]: INFO cinder.volume.manager [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 01:06:31 devstack cinder-volume[81318]: WARNING stevedore.named [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 01:06:31 devstack cinder-volume[81318]: WARNING castellan.key_manager [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 01:06:31 devstack cinder-volume[81318]: WARNING cinder.keymgr.conf_key_mgr [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 01:06:31 devstack cinder-volume[81318]: INFO cinder.volume.manager [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_db.sqlalchemy.engines [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:06:31 devstack cinder-volume[81318]: INFO oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Starting 1 workers Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Started child 81437 {{(pid=81318) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Full set of CONF: {{(pid=81318) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] ******************************************************************************** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Configuration options gathered from: {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 01:06:31 devstack cinder-volume[81437]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] ================================================================================ {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] allow_availability_zone_fallback = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] allow_compression_on_image_upload = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] allowed_direct_url_schemes = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] api_rate_limit = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] auth_strategy = keystone {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_availability_zone = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_host = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_stats_polling_interval = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backup_api_class = cinder.backup.api.API {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backup_name_template = backup-%s {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backup_use_same_host = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backup_use_temp_snapshot = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] chap_password = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] chap_username = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_internal_tenant_project_id = c28bde0c11974ffc92e3cea72cff631a {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_internal_tenant_user_id = 8c46656ebaf8492d8e371f2940265774 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cluster = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] compression_format = gzip {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] compute_api_class = cinder.compute.nova.API {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] config_dir = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] config_source = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] control_exchange = openstack {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] debug = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] default_availability_zone = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] default_group_type = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] default_volume_type = QuobyteHD {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] disk_geometry = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] driver_client_cert = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] driver_client_cert_key = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] driver_data_namespace = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81437]: INFO cinder.volume.manager [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 01:06:31 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.remotefs [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81437) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] driver_ssl_cert_path = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] driver_ssl_cert_verify = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] driver_use_ssl = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] enable_new_services = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] enable_unsupported_driver = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] enabled_backends = ['QuobyteHD'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] enforce_multipath_for_image_xfer = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] filter_function = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_api_insecure = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_api_servers = ['http://192.168.122.180/image'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_api_ssl_compression = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_ca_certificates_file = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_catalog_info = image:glance:publicURL {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_certfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_keyfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_num_retries = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance_request_timeout = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] goodness_function = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] graceful_shutdown_timeout = 5 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] group_api_class = cinder.group.api.API {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] host = devstack {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_compress_on_upload = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_conversion_address_space_limit = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_conversion_cpu_limit = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_conversion_disable = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_upload_use_cinder_backend = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_upload_use_internal_tenant = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_volume_cache_enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_volume_cache_max_count = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] image_volume_cache_max_size_gb = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] init_host_max_objects_retrieval = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] instance_format = [instance: %(uuid)s] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] iscsi_target_flags = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] iscsi_write_cache = on {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] iser_helper = tgtadm {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] iser_ip_address = 192.168.122.180 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] iser_port = 3260 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_color = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_config_append = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_dir = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_file = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_options = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_rotate_interval = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_rotate_interval_type = days {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] log_rotation_type = none {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] max_age = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] max_logfile_count = 30 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] max_logfile_size_mb = 200 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] max_over_subscription_ratio = 20.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] message_reap_interval = 86400 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] message_ttl = 2592000 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] migration_create_volume_timeout_secs = 300 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] monkey_patch = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] monkey_patch_modules = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] my_ip = 192.168.122.180 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] no_snapshot_gb_quota = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] num_iser_scan_tries = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] num_shell_tries = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] num_volume_device_scan_tries = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] nvmeof_conn_info_version = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] nvmet_ns_id = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] nvmet_port_id = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] osapi_max_limit = 1000 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] osapi_volume_ext_list = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] osapi_volume_listen = 0.0.0.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] osapi_volume_listen_port = 8776 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] osapi_volume_use_ssl = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81437) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 01:06:31 devstack cinder-volume[81437]: WARNING cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 01:06:31 devstack cinder-volume[81437]: WARNING cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] osapi_volume_workers = 2 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] per_volume_size_limit = -1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Running cmd (subprocess): mount.quobyte {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] periodic_fuzzy_delay = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] periodic_interval = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] project_id_regex = [0-9a-f\-]+ {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] public_endpoint = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] publish_errors = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] quota_backup_gigabytes = 1000 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] quota_backups = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] quota_gigabytes = 1000 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] quota_groups = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] quota_snapshots = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] quota_volumes = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] rate_limit_burst = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] rate_limit_except_level = CRITICAL {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] rate_limit_interval = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] reinit_driver_count = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] replication_device = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] report_discard_supported = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] report_interval = 120 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] reservation_clean_interval = 86400 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] reservation_expire = 86400 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] reserved_image_namespaces = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] reserved_percentage = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] rpc_response_timeout = 120 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] run_external_periodic_tasks = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] scst_target_driver = iscsi {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] scst_target_iqn_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_down_time = 720 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] shell_completion = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] snapshot_name_template = snapshot-%s {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] split_loggers = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] state_path = /opt/stack/data/cinder {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] storage_availability_zone = nova {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] storage_protocol = iSCSI {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] syslog_log_facility = LOG_USER {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] target_helper = lioadm {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] target_ip_address = 192.168.122.180 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] target_port = 3260 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] target_protocol = iscsi {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] target_secondary_ip_addresses = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] trace_flags = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] transfer_api_class = cinder.transfer.api.API {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] transport_url = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] until_refresh = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] use_chap_auth = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] use_default_quota_class = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] use_journal = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] use_json = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] use_multipath_for_image_xfer = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] use_stderr = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] use_syslog = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] verify_glance_signatures = enabled {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_api_class = cinder.volume.api.API {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_backend_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_clear = zero {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_clear_ionice = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_clear_size = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_copy_bps_limit = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_dd_blocksize = 1M {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_name_template = volume-%s {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_service_inithost_offload = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volume_usage_audit_period = month {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] zoning_mode = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_concurrency.disable_process_locking = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.admin_password = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.admin_token = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.admin_user = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.auth_admin_prefix = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.auth_port = 35357 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.auth_protocol = https {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.auth_section = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.auth_type = password {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.auth_uri = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.auth_version = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.cache = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.certfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.delay_auth_decision = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.http_connect_timeout = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack quobyte-client[81438]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 01:06:31 devstack quobyte-client[81438]: Invalid parameters found, error: missing mount point. Apr 24 01:06:31 devstack quobyte-client[81438]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 01:06:31 devstack quobyte-client[81438]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.identity_uri = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.include_service_catalog = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.insecure = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.interface = public {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.keyfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_password = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:06:31 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:06:31 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcache_username = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81437]: INFO cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b ... Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 -c /etc/quobyte/client-cinder.cfg {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.region_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.service_token_roles_required = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.service_type = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.token_cache_time = 300 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.backend = dogpile.cache.null {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.backend_argument = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.backend_expiration_time = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.config_prefix = cache.oslo {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.debug_cache_backend = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.enable_retry_client = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.enable_socket_keepalive = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.enforce_fips_mode = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.expiration_time = 600 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.hashclient_retry_attempts = 2 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.memcache_dead_retry = 300 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.memcache_pool_maxsize = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.memcache_sasl_enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack sudo[81439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 -c /etc/quobyte/client-cinder.cfg Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack sudo[81439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.password = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.proxies = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.redis_db = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.redis_sentinel_service_name = mymaster {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.redis_server = localhost:6379 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.retry_attempts = 2 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.retry_delay = 0.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.socket_keepalive_count = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.socket_keepalive_idle = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.socket_keepalive_interval = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.socket_timeout = 1.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.tls_allowed_ciphers = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.tls_cafile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.tls_certfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.tls_enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.tls_keyfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cache.username = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] coordination.backend_url = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.asyncio_connection = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.asyncio_slave_connection = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.backend = sqlalchemy {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.connection = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.connection_debug = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.connection_parameters = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.connection_recycle_time = 3600 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.connection_trace = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.db_inc_retry_interval = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.db_max_retries = 20 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.db_max_retry_interval = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.db_retry_interval = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.max_overflow = 50 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.max_pool_size = 5 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.max_retries = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.mysql_wsrep_sync_wait = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.pool_timeout = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.retry_interval = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.slave_connection = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.sqlite_synchronous = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.synchronous_reader = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] database.use_db_reconnect = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.connection_string = messaging:// {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.es_doc_type = notification {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.es_scroll_size = 10000 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.es_scroll_time = 2m {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.filter_error_trace = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.hmac_keys = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.sentinel_service_name = mymaster {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.socket_timeout = 0.1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.trace_requests = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler.trace_sqlalchemy = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler_jaeger.process_tags = {} {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler_jaeger.service_name_prefix = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] profiler_otlp.service_name_prefix = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.enforce_new_defaults = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: WARNING oslo_config.cfg [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.enforce_scope = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.policy_default_rule = default {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.policy_file = policy.yaml {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_policy.remote_timeout = 60.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] privsep_osbrick.group = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] privsep_osbrick.helper_command = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] privsep_osbrick.user = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_sys_admin.group = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_sys_admin.helper_command = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] cinder_sys_admin.user = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.auth_section = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.auth_type = password {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.cafile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.certfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.collect_timing = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.insecure = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.keyfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.send_service_user_token = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.split_loggers = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] service_user.timeout = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.auth_section = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.auth_type = password {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.certfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.collect_timing = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.insecure = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.keyfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.region_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.split_loggers = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] glance.timeout = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.backend_availability_zone = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.chap_password = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.chap_username = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.disk_geometry = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.driver_client_cert = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.driver_client_cert_key = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.driver_data_namespace = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.driver_use_ssl = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.enable_unsupported_driver = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.extra_capabilities = {} {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.filter_function = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.goodness_function = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.iscsi_target_flags = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.iscsi_write_cache = on {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.iser_helper = tgtadm {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.iser_port = 3260 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_host = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_login = admin {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_mount_options = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_password = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_private_key = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_share_path = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_ssh_port = 22 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.num_shell_tries = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.nvmet_port_id = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.quobyte_client_cfg = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.quobyte_volume_url = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.replication_device = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.report_discard_supported = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.reserved_percentage = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.scst_target_driver = iscsi {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.scst_target_iqn_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.storage_protocol = iSCSI {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.target_helper = tgtadm {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.target_port = 3260 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.target_protocol = iscsi {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.trace_flags = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.unique_fqdn_network = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.use_chap_auth = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volume_backend_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volume_clear = zero {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volume_clear_ionice = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volume_clear_size = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_reports.file_event_handler = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_reports.log_dir = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.backend_availability_zone = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.backend_host = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.chap_password = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.chap_username = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.chiscsi_conf = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.disk_geometry = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.driver_client_cert = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.driver_client_cert_key = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.driver_data_namespace = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.driver_use_ssl = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.extra_capabilities = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.filter_function = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.goodness_function = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.iscsi_target_flags = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.iscsi_write_cache = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.iser_helper = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.iser_ip_address = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.iser_port = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.iser_target_prefix = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_host = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_login = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_mount_options = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_password = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_private_key = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_share_path = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_ssh_port = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.num_shell_tries = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nvmet_ns_id = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.nvmet_port_id = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.replication_device = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.report_discard_supported = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.reserved_percentage = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.scst_target_driver = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.storage_protocol = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.target_helper = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.target_ip_address = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.target_port = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.target_prefix = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.target_protocol = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.trace_flags = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.unique_fqdn_network = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.use_chap_auth = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volume_clear = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volume_clear_ionice = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volume_clear_size = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] QuobyteHD.volumes_dir = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.ssl = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.ssl_version = {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_notifications.driver = [] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_notifications.retry = -1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] oslo_messaging_notifications.transport_url = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] key_manager.fixed_key = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.barbican_api_version = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.barbican_endpoint = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.barbican_endpoint_type = public {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.barbican_region_name = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.cafile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.certfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.collect_timing = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.insecure = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.keyfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.number_of_retries = 60 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.retry_delay = 1 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.send_service_user_token = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.split_loggers = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.timeout = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.verify_ssl = True {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican.verify_ssl_path = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.auth_section = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.auth_type = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.cafile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.certfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.collect_timing = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.insecure = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.keyfile = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.split_loggers = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] barbican_service_user.timeout = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.approle_role_id = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.approle_secret_id = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.kv_mountpoint = secret {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.kv_path = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.kv_version = 2 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.namespace = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.root_token_id = **** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.ssl_ca_crt_file = None {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.timeout = 60.0 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.use_ssl = False {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:31 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] ******************************************************************************** {{(pid=81318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 01:06:32 devstack sudo[81439]: pam_unix(sudo:session): session closed for user root Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.582s {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:32 devstack cinder-volume[81437]: INFO cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b succeeded Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.592s {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:32 devstack sudo[81508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:06:32 devstack sudo[81508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:06:32 devstack sudo[81508]: pam_unix(sudo:session): session closed for user root Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.450s {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:32 devstack cinder-volume[81437]: INFO cinder.volume.driver [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Driver hasn't implemented _init_vendor_properties() Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG cinder.volume.driver [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6693420410156, 'free_capacity_gb': 1775.6693420410156, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81437) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_db.sqlalchemy.engines [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81437) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG dbcounter [-] [81437] Writer thread running {{(pid=81437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG cinder.db.sqlalchemy.api [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Building query based on filter {{(pid=81437) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG cinder.image.image_utils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81437) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 01:06:32 devstack cinder-volume[81437]: INFO cinder.keymgr.migration [None req-cf0306d1-ce15-4412-bcfc-6b49e674635b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:06:32 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:32 devstack sudo[81511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:06:32 devstack sudo[81511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:06:33 devstack sudo[81511]: pam_unix(sudo:session): session closed for user root Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.472s {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG cinder.manager [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Notifying Schedulers of capabilities ... {{(pid=81437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:06:33 devstack cinder-volume[81437]: INFO cinder.volume.manager [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Driver initialization completed successfully. Apr 24 01:06:33 devstack cinder-volume[81437]: INFO cinder.manager [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Initiating service 3 cleanup Apr 24 01:06:33 devstack cinder-volume[81437]: INFO cinder.manager [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Service 3 cleanup completed. Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG cinder.service [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Creating RPC server for service cinder-volume {{(pid=81437) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG cinder.service [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81437) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 01:06:33 devstack cinder-volume[81437]: INFO cinder.volume.manager [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:06:33 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:33 devstack sudo[81518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:06:33 devstack sudo[81518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:06:34 devstack sudo[81518]: pam_unix(sudo:session): session closed for user root Apr 24 01:06:34 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.561s {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:34 devstack cinder-volume[81437]: INFO cinder.volume.manager [None req-a7fee39d-cb5b-41e9-800f-dcbaeeab77af None None] Driver post RPC initialization completed successfully. Apr 24 01:06:37 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-1c661a73-3750-46d8-9420-5c7b70a8e128 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:06:37 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-1c661a73-3750-46d8-9420-5c7b70a8e128 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:06:37 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-1c661a73-3750-46d8-9420-5c7b70a8e128 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:06:37 devstack cinder-volume[81437]: DEBUG cinder.volume.drivers.quobyte [None req-1c661a73-3750-46d8-9420-5c7b70a8e128 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:06:37 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-1c661a73-3750-46d8-9420-5c7b70a8e128 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81437) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:06:37 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-1c661a73-3750-46d8-9420-5c7b70a8e128 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:37 devstack sudo[81583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:06:37 devstack sudo[81583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:06:37 devstack sudo[81583]: pam_unix(sudo:session): session closed for user root Apr 24 01:06:37 devstack cinder-volume[81437]: DEBUG oslo_concurrency.processutils [None req-1c661a73-3750-46d8-9420-5c7b70a8e128 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.452s {{(pid=81437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:37 devstack cinder-volume[81437]: DEBUG cinder.manager [None req-1c661a73-3750-46d8-9420-5c7b70a8e128 None None] Notifying Schedulers of capabilities ... {{(pid=81437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:06:39 devstack cinder-volume[81318]: INFO oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Caught SIGTERM, stopping children Apr 24 01:06:39 devstack cinder-volume[81318]: DEBUG oslo_concurrency.lockutils [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Acquiring lock "singleton_lock" {{(pid=81318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 01:06:39 devstack cinder-volume[81318]: DEBUG oslo_concurrency.lockutils [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Acquired lock "singleton_lock" {{(pid=81318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 01:06:39 devstack cinder-volume[81318]: DEBUG oslo_concurrency.lockutils [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Releasing lock "singleton_lock" {{(pid=81318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 01:06:39 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Stop services. {{(pid=81318) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 01:06:39 devstack cinder-volume[81318]: DEBUG oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Killing children. {{(pid=81318) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 01:06:39 devstack cinder-volume[81318]: INFO oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Waiting on 1 children to exit Apr 24 01:06:41 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Acquiring lock "singleton_lock" {{(pid=81437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 01:06:41 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Acquired lock "singleton_lock" {{(pid=81437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 01:06:41 devstack cinder-volume[81437]: DEBUG oslo_concurrency.lockutils [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Releasing lock "singleton_lock" {{(pid=81437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 01:06:41 devstack cinder-volume[81437]: WARNING amqp [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 01:06:41 devstack cinder-volume[81437]: WARNING amqp [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 01:06:41 devstack cinder-volume[81318]: INFO oslo_service.backend._eventlet.service [None req-69d5071f-4dd4-4b0a-a315-16fabd1dd25a None None] Child 81437 exited with status 0 Apr 24 01:06:42 devstack cinder-volume[81667]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 01:06:42 devstack cinder-volume[81667]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 01:06:42 devstack cinder-volume[81667]: we strongly recommend against using it for new projects. Apr 24 01:06:42 devstack cinder-volume[81667]: If you are already using Eventlet, we recommend migrating to a different Apr 24 01:06:42 devstack cinder-volume[81667]: framework. For more detail see Apr 24 01:06:42 devstack cinder-volume[81667]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 01:06:42 devstack cinder-volume[81667]: import eventlet # noqa Apr 24 01:06:44 devstack cinder-volume[81667]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81667) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 01:06:44 devstack cinder-volume[81667]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81667) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 01:06:44 devstack cinder-volume[81667]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81667) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 01:06:45 devstack cinder-volume[81667]: INFO dbcounter [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Registered counter for database cinder Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_db.sqlalchemy.engines [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81667) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG dbcounter [-] [81667] Writer thread running {{(pid=81667) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 01:06:45 devstack cinder-volume[81667]: INFO cinder.rpc [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 01:06:45 devstack cinder-volume[81667]: INFO cinder.rpc [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_db.sqlalchemy.engines [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81667) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:06:45 devstack cinder-volume[81667]: INFO cinder.volume.manager [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Determined volume DB was empty at startup. Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG cinder.volume.manager [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81667) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 01:06:45 devstack cinder-volume[81667]: WARNING stevedore.named [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 01:06:45 devstack cinder-volume[81667]: WARNING castellan.key_manager [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 01:06:45 devstack cinder-volume[81667]: WARNING cinder.keymgr.conf_key_mgr [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 01:06:45 devstack cinder-volume[81667]: INFO cinder.volume.manager [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_db.sqlalchemy.engines [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81667) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:06:45 devstack cinder-volume[81667]: INFO oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Starting 1 workers Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Started child 81925 {{(pid=81667) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Full set of CONF: {{(pid=81667) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] ******************************************************************************** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Configuration options gathered from: {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] ================================================================================ {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] allow_availability_zone_fallback = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] allow_compression_on_image_upload = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] allowed_direct_url_schemes = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] api_rate_limit = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] auth_strategy = keystone {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_availability_zone = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_host = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81925]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_stats_polling_interval = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backup_api_class = cinder.backup.api.API {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backup_name_template = backup-%s {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backup_use_same_host = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backup_use_temp_snapshot = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] chap_password = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] chap_username = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_internal_tenant_project_id = c28bde0c11974ffc92e3cea72cff631a {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_internal_tenant_user_id = 8c46656ebaf8492d8e371f2940265774 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cluster = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] compression_format = gzip {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] compute_api_class = cinder.compute.nova.API {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] config_dir = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] config_source = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] control_exchange = openstack {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] debug = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] default_availability_zone = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] default_group_type = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] default_volume_type = QuobyteHD {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] disk_geometry = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] driver_client_cert = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] driver_client_cert_key = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] driver_data_namespace = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] driver_ssl_cert_path = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] driver_ssl_cert_verify = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] driver_use_ssl = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] enable_new_services = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] enable_unsupported_driver = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] enabled_backends = ['QuobyteHD'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] enforce_multipath_for_image_xfer = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] filter_function = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_api_insecure = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_api_servers = ['http://192.168.122.180/image'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_api_ssl_compression = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_ca_certificates_file = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_catalog_info = image:glance:publicURL {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_certfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_keyfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_num_retries = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance_request_timeout = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] goodness_function = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] graceful_shutdown_timeout = 5 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] group_api_class = cinder.group.api.API {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] host = devstack {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_compress_on_upload = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_conversion_address_space_limit = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_conversion_cpu_limit = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_conversion_disable = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_upload_use_cinder_backend = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_upload_use_internal_tenant = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_volume_cache_enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_volume_cache_max_count = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] image_volume_cache_max_size_gb = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] init_host_max_objects_retrieval = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] instance_format = [instance: %(uuid)s] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] iscsi_target_flags = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81925) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] iscsi_write_cache = on {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] iser_helper = tgtadm {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] iser_ip_address = 192.168.122.180 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] iser_port = 3260 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_color = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_config_append = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_dir = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_file = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_options = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_rotate_interval = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_rotate_interval_type = days {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:45 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] log_rotation_type = none {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] max_age = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] max_logfile_count = 30 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] max_logfile_size_mb = 200 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] max_over_subscription_ratio = 20.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] message_reap_interval = 86400 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] message_ttl = 2592000 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] migration_create_volume_timeout_secs = 300 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack sudo[81934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] monkey_patch = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] monkey_patch_modules = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] my_ip = 192.168.122.180 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] no_snapshot_gb_quota = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] num_iser_scan_tries = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] num_shell_tries = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] num_volume_device_scan_tries = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack sudo[81934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] nvmeof_conn_info_version = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] nvmet_ns_id = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] nvmet_port_id = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] osapi_max_limit = 1000 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] osapi_volume_ext_list = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] osapi_volume_listen_port = 8776 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] osapi_volume_use_ssl = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] osapi_volume_workers = 2 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] per_volume_size_limit = -1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] periodic_fuzzy_delay = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] periodic_interval = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] public_endpoint = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] publish_errors = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] quota_backup_gigabytes = 1000 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] quota_backups = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] quota_gigabytes = 1000 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] quota_groups = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] quota_snapshots = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] quota_volumes = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] rate_limit_burst = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] rate_limit_except_level = CRITICAL {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] rate_limit_interval = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] reinit_driver_count = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] replication_device = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] report_discard_supported = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] report_interval = 120 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] reservation_clean_interval = 86400 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] reservation_expire = 86400 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] reserved_image_namespaces = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] reserved_percentage = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] rpc_response_timeout = 120 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] run_external_periodic_tasks = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] scst_target_driver = iscsi {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] scst_target_iqn_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_down_time = 720 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] shell_completion = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] snapshot_name_template = snapshot-%s {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] split_loggers = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] state_path = /opt/stack/data/cinder {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] storage_availability_zone = nova {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] storage_protocol = iSCSI {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] syslog_log_facility = LOG_USER {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] target_helper = lioadm {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] target_ip_address = 192.168.122.180 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] target_port = 3260 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] target_protocol = iscsi {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] target_secondary_ip_addresses = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] trace_flags = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] transport_url = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] until_refresh = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] use_chap_auth = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] use_default_quota_class = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] use_journal = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] use_json = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] use_multipath_for_image_xfer = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] use_stderr = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] use_syslog = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] verify_glance_signatures = enabled {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_api_class = cinder.volume.api.API {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_backend_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_clear = zero {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_clear_ionice = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_clear_size = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_copy_bps_limit = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_dd_blocksize = 1M {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_name_template = volume-%s {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_service_inithost_offload = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volume_usage_audit_period = month {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] zoning_mode = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_concurrency.disable_process_locking = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.admin_password = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.admin_token = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.admin_user = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.auth_port = 35357 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.auth_protocol = https {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.auth_section = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.auth_type = password {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.auth_uri = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.auth_version = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.cache = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.certfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.identity_uri = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.include_service_catalog = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.insecure = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.interface = public {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.keyfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_password = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcache_username = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.region_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.service_type = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.backend = dogpile.cache.null {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.backend_argument = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.backend_expiration_time = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.config_prefix = cache.oslo {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.debug_cache_backend = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.enable_retry_client = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.enable_socket_keepalive = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.enforce_fips_mode = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.expiration_time = 600 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.hashclient_retry_attempts = 2 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.memcache_dead_retry = 300 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.memcache_pool_maxsize = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.memcache_sasl_enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.password = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.proxies = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.redis_db = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81925) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.redis_server = localhost:6379 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.retry_attempts = 2 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.retry_delay = 0.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.socket_keepalive_count = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.socket_keepalive_idle = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.socket_keepalive_interval = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.socket_timeout = 1.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.tls_allowed_ciphers = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.tls_cafile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.tls_certfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.tls_enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.tls_keyfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cache.username = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] coordination.backend_url = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.asyncio_connection = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Running cmd (subprocess): mount.quobyte {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.asyncio_slave_connection = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.backend = sqlalchemy {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.connection = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.connection_debug = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.connection_parameters = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.connection_recycle_time = 3600 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.connection_trace = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.db_inc_retry_interval = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.db_max_retries = 20 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.db_max_retry_interval = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.db_retry_interval = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.max_overflow = 50 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.max_pool_size = 5 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.max_retries = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.mysql_wsrep_sync_wait = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.pool_timeout = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.retry_interval = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.slave_connection = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.sqlite_synchronous = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.synchronous_reader = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] database.use_db_reconnect = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.connection_string = messaging:// {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.es_doc_type = notification {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.es_scroll_size = 10000 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.es_scroll_time = 2m {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.filter_error_trace = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.hmac_keys = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.sentinel_service_name = mymaster {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.socket_timeout = 0.1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.trace_requests = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler.trace_sqlalchemy = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler_jaeger.process_tags = {} {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler_jaeger.service_name_prefix = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] profiler_otlp.service_name_prefix = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.enforce_new_defaults = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: WARNING oslo_config.cfg [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.enforce_scope = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.policy_default_rule = default {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.policy_file = policy.yaml {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] privsep_osbrick.group = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] privsep_osbrick.helper_command = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] privsep_osbrick.user = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_sys_admin.group = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_sys_admin.helper_command = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] cinder_sys_admin.user = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.auth_section = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.auth_type = password {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.cafile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.certfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.collect_timing = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.insecure = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.keyfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.send_service_user_token = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.split_loggers = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] service_user.timeout = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.auth_section = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.auth_type = password {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.certfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.collect_timing = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.insecure = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.keyfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.region_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.split_loggers = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] glance.timeout = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.backend_availability_zone = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.chap_password = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.chap_username = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.disk_geometry = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.driver_client_cert = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.driver_client_cert_key = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.driver_data_namespace = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.driver_use_ssl = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.extra_capabilities = {} {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.filter_function = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.goodness_function = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.iscsi_target_flags = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.iscsi_write_cache = on {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.iser_helper = tgtadm {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.iser_port = 3260 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_host = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_login = admin {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_mount_options = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_password = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_private_key = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_share_path = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.num_shell_tries = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.quobyte_volume_url = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.replication_device = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.report_discard_supported = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.reserved_percentage = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.target_helper = tgtadm {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.target_port = 3260 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.target_protocol = iscsi {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.trace_flags = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.unique_fqdn_network = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.use_chap_auth = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volume_backend_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volume_clear = zero {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volume_clear_ionice = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volume_clear_size = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_reports.file_event_handler = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_reports.log_dir = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.backend_availability_zone = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.backend_host = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.chap_password = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.chap_username = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.chiscsi_conf = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.disk_geometry = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.driver_client_cert = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.driver_data_namespace = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.driver_use_ssl = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.extra_capabilities = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.filter_function = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.goodness_function = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.iser_helper = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.iser_ip_address = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.iser_port = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.iser_target_prefix = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_host = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_login = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_mount_options = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_password = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_private_key = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_share_path = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_ssh_port = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.num_shell_tries = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.nvmet_port_id = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.replication_device = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.report_discard_supported = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.reserved_percentage = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.scst_target_driver = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.storage_protocol = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.target_helper = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.target_ip_address = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.target_port = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.target_prefix = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.target_protocol = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.trace_flags = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.use_chap_auth = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volume_clear = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volume_clear_size = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] QuobyteHD.volumes_dir = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.ssl = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_notifications.driver = [] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_notifications.retry = -1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] key_manager.fixed_key = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.barbican_api_version = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.barbican_endpoint = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.barbican_endpoint_type = public {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.barbican_region_name = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.cafile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.certfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.collect_timing = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.insecure = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.keyfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.number_of_retries = 60 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.retry_delay = 1 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.send_service_user_token = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.split_loggers = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.timeout = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.verify_ssl = True {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican.verify_ssl_path = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.auth_section = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.auth_type = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.cafile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.certfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.collect_timing = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.insecure = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.keyfile = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.split_loggers = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] barbican_service_user.timeout = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.approle_role_id = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.approle_secret_id = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.kv_mountpoint = secret {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.kv_path = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.kv_version = 2 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.namespace = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.root_token_id = **** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.ssl_ca_crt_file = None {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.timeout = 60.0 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.use_ssl = False {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 01:06:46 devstack cinder-volume[81667]: DEBUG oslo_service.backend._eventlet.service [None req-67954405-62ef-4618-9021-019ff4bc6dc4 None None] ******************************************************************************** {{(pid=81667) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 01:06:46 devstack sudo[81934]: pam_unix(sudo:session): session closed for user root Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.634s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:46 devstack cinder-volume[81925]: INFO cinder.volume.driver [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Driver hasn't implemented _init_vendor_properties() Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG cinder.volume.driver [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6681632995605, 'free_capacity_gb': 1775.6681632995605, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81925) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_db.sqlalchemy.engines [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writer thread running {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG cinder.db.sqlalchemy.api [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Building query based on filter {{(pid=81925) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81925) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:06:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:46 devstack cinder-volume[81925]: INFO cinder.keymgr.migration [None req-9f036f99-5d9a-413c-bff1-ccecd073ddd2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 01:06:46 devstack sudo[81944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:06:46 devstack sudo[81944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:06:47 devstack sudo[81944]: pam_unix(sudo:session): session closed for user root Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.462s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:06:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Driver initialization completed successfully. Apr 24 01:06:47 devstack cinder-volume[81925]: INFO cinder.manager [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Initiating service 3 cleanup Apr 24 01:06:47 devstack cinder-volume[81925]: INFO cinder.manager [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Service 3 cleanup completed. Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG cinder.service [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Creating RPC server for service cinder-volume {{(pid=81925) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG cinder.service [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81925) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 01:06:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:06:47 devstack sudo[81951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:06:47 devstack sudo[81951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:06:47 devstack sudo[81951]: pam_unix(sudo:session): session closed for user root Apr 24 01:06:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.462s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:06:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1b496161-1dbc-43b5-bee1-a9aaa5927d2f None None] Driver post RPC initialization completed successfully. Apr 24 01:06:55 devstack cinder-volume[81667]: DEBUG dbcounter [-] [81667] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81667) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:06:57 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:06:57 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=3 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:07:45 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:07:45 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Flow 'volume_create_manager' (b82c8a20-4cc7-467c-a0db-524775aaae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:07:45 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a667bc-3251-43d5-9997-8f59a66cb0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a667bc-3251-43d5-9997-8f59a66cb0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2048673869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2981a5-5820-45ec-8873-b193c7bb78d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e684a9c1fc55455eab3d9fd08bb12734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:07:46Z,use_quota=True,user_id='205be51e44fd40328e005405039fe45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a017e7-6a78-45ff-8ef1-505b5b928b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a017e7-6a78-45ff-8ef1-505b5b928b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a47583-0ae5-4e0f-b291-a8729fc39567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a47583-0ae5-4e0f-b291-a8729fc39567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2981a5-5820-45ec-8873-b193c7bb78d7', 'volume_name': 'volume-4b2981a5-5820-45ec-8873-b193c7bb78d7', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d877b163-1789-48b0-ac6b-1515a3fb6056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d877b163-1789-48b0-ac6b-1515a3fb6056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec5e01a-c281-45b1-8ff2-77cca5533fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:07:46 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Volume 4b2981a5-5820-45ec-8873-b193c7bb78d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2981a5-5820-45ec-8873-b193c7bb78d7', 'volume_size': 1} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2048673869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2981a5-5820-45ec-8873-b193c7bb78d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e684a9c1fc55455eab3d9fd08bb12734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:07:46Z,use_quota=True,user_id='205be51e44fd40328e005405039fe45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Creating volume 4b2981a5-5820-45ec-8873-b193c7bb78d7 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:07:46 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:07:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:46 devstack sudo[82158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 1073741824 Apr 24 01:07:46 devstack sudo[82158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:47 devstack sudo[82158]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 1073741824" returned: 0 in 1.046s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:47 devstack sudo[82489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 Apr 24 01:07:47 devstack sudo[82489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:48 devstack sudo[82489]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7" returned: 0 in 0.988s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:07:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:07:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec5e01a-c281-45b1-8ff2-77cca5533fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2981a5-5820-45ec-8873-b193c7bb78d7', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:07:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eaf6ca6-0f55-46d4-83e7-0969e999ccc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:07:48 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Volume volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 (4b2981a5-5820-45ec-8873-b193c7bb78d7): created successfully Apr 24 01:07:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eaf6ca6-0f55-46d4-83e7-0969e999ccc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:07:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Flow 'volume_create_manager' (b82c8a20-4cc7-467c-a0db-524775aaae7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:07:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-e844d841-caa1-4d08-bd3b-73a31b9cec76 req-3bab9635-9a2e-493c-bb60-8fb0667fb15b tempest-VolumesSnapshotsTestJSON-1722813655 None] Created volume successfully. Apr 24 01:07:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:07:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:07:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Creating offline snapshot ac53e0ee-c815-492f-91a2-c86c1586c78b of volume 4b2981a5-5820-45ec-8873-b193c7bb78d7 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:07:49 devstack cinder-volume[81925]: INFO oslo.privsep.daemon [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphpw9jbwk/privsep.sock'] Apr 24 01:07:49 devstack sudo[82521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphpw9jbwk/privsep.sock Apr 24 01:07:49 devstack sudo[82521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 01:07:50 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 01:07:51 devstack cinder-volume[81925]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 24 01:07:51 devstack sudo[82521]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:51 devstack cinder-volume[81925]: INFO oslo.privsep.daemon [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Spawned new privsep daemon via rootwrap Apr 24 01:07:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Accepted privsep connection to /tmp/tmphpw9jbwk/privsep.sock {{(pid=81925) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 24 01:07:51 devstack cinder-volume[81925]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 24 01:07:51 devstack cinder-volume[81925]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 24 01:07:51 devstack cinder-volume[81925]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 24 01:07:51 devstack cinder-volume[81925]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82536 Apr 24 01:07:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdd60d1-0793-4dc8-a2db-5d5666a8aa6d]: (2,) {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:07:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5976d8d-7ce0-4734-9b49-80c329909a13]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:07:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:51 devstack sudo[82539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 Apr 24 01:07:51 devstack sudo[82539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:52 devstack sudo[82539]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7" returned: 0 in 0.877s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:52 devstack sudo[82553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b 1G Apr 24 01:07:52 devstack sudo[82553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:53 devstack sudo[82553]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b 1G" returned: 0 in 1.094s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:53 devstack sudo[82587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b Apr 24 01:07:53 devstack sudo[82587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:54 devstack sudo[82587]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b" returned: 0 in 1.038s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:54 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b is being set with open permissions: ugo+rw Apr 24 01:07:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:54 devstack sudo[82617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b Apr 24 01:07:54 devstack sudo[82617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:55 devstack sudo[82617]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b" returned: 0 in 0.613s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:55 devstack sudo[82627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.info Apr 24 01:07:55 devstack sudo[82627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:55 devstack sudo[82627]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.info" returned: 0 in 0.536s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:55 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.info is being set with open permissions: ugo+rw Apr 24 01:07:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:55 devstack sudo[82631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.info Apr 24 01:07:55 devstack sudo[82631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:56 devstack sudo[82631]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.info" returned: 0 in 0.561s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.746s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:07:56 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-bc0700ea-78d0-42da-a61b-a65ae3b45edf req-307682db-98f5-42fd-aa9d-d9231d6e526b tempest-VolumesSnapshotsTestJSON-1722813655 None] Create snapshot completed successfully Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "cinder-ac53e0ee-c815-492f-91a2-c86c1586c78b-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-ac53e0ee-c815-492f-91a2-c86c1586c78b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "cinder-quobyte-4b2981a5-5820-45ec-8873-b193c7bb78d7" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-quobyte-4b2981a5-5820-45ec-8873-b193c7bb78d7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "cinder-quobyte-ac53e0ee-c815-492f-91a2-c86c1586c78b" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-quobyte-ac53e0ee-c815-492f-91a2-c86c1586c78b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Deleting offline snapshot ac53e0ee-c815-492f-91a2-c86c1586c78b of volume 4b2981a5-5820-45ec-8873-b193c7bb78d7 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] snapshot_file for this snap is: volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5ad47-380d-469d-97c0-92a0328904ac]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:07:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:57 devstack sudo[82644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b Apr 24 01:07:57 devstack sudo[82644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:58 devstack sudo[82644]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b" returned: 0 in 0.595s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b2981a5-5820-45ec-8873-b193c7bb78d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:07:58 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d2f34-5396-413b-81b4-7f0c820eb833]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:07:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:58 devstack sudo[82650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 Apr 24 01:07:58 devstack sudo[82650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:58 devstack sudo[82650]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7" returned: 0 in 0.582s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:58 devstack sudo[82659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b Apr 24 01:07:58 devstack sudo[82659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:59 devstack sudo[82659]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:07:59 devstack sudo[82668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b Apr 24 01:07:59 devstack sudo[82668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:07:59 devstack sudo[82668]: pam_unix(sudo:session): session closed for user root Apr 24 01:07:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7.ac53e0ee-c815-492f-91a2-c86c1586c78b" returned: 0 in 0.426s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:07:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-quobyte-ac53e0ee-c815-492f-91a2-c86c1586c78b" released by "_delete_snapshot" :: held 2.280s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:07:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-quobyte-4b2981a5-5820-45ec-8873-b193c7bb78d7" released by "delete_snapshot" :: held 2.316s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:00 devstack cinder-volume[81925]: WARNING cinder.quota [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:08:00 devstack cinder-volume[81925]: WARNING cinder.quota [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:08:03 devstack cinder-volume[81925]: DEBUG cinder.quota [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Created reservations ['0d8e0a93-b986-4845-b02c-8e9889f9bd6b', '16ff9a2e-a224-4839-b90a-30a76774a901', '10dd2503-f9be-48c7-bb64-b49951680f1b', 'c2061e7a-7166-46be-a2d8-dc7059122170'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:03 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Delete snapshot completed successfully. Apr 24 01:08:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-7f5fbb9c-1a23-468e-95e7-3273f00cdd8b req-c19fc4ca-3674-4447-a72a-ac632c766d5b tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-ac53e0ee-c815-492f-91a2-c86c1586c78b-delete_snapshot" released by "delete_snapshot" :: held 5.724s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "cinder-4b2981a5-5820-45ec-8873-b193c7bb78d7-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-4b2981a5-5820-45ec-8873-b193c7bb78d7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "cinder-quobyte-4b2981a5-5820-45ec-8873-b193c7bb78d7" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-quobyte-4b2981a5-5820-45ec-8873-b193c7bb78d7" acquired by "delete_volume" :: waited 0.027s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:04 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6459ca0b-928b-480f-908a-8b5989f2679c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:04 devstack sudo[82718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 Apr 24 01:08:04 devstack sudo[82718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:05 devstack sudo[82718]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7" returned: 0 in 0.795s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:05 devstack sudo[82724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7 Apr 24 01:08:05 devstack sudo[82724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:05 devstack sudo[82724]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b2981a5-5820-45ec-8873-b193c7bb78d7" returned: 0 in 0.640s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-quobyte-4b2981a5-5820-45ec-8873-b193c7bb78d7" released by "delete_volume" :: held 1.534s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:05 devstack cinder-volume[81925]: WARNING cinder.quota [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG cinder.quota [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Created reservations ['580b0c83-9e26-4eea-bb44-748fd1374fa6', '03518429-9cb7-4c82-bde9-22f9b61b0adb', 'dbb7a3a0-8f87-4e56-a4a4-5aa62e6fc93d', '23b0a1be-8102-4366-8c89-9887eafca648'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:05 devstack sudo[82763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:08:05 devstack sudo[82763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:06 devstack sudo[82763]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.582s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:06 devstack cinder-volume[81925]: DEBUG cinder.manager [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:08:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Deleted volume successfully. Apr 24 01:08:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-849ddd0e-e79b-4738-a24a-452001cd70a7 req-722dc80d-21ac-4ac3-9275-522784d2bf23 tempest-VolumesSnapshotsTestJSON-1722813655 None] Lock "cinder-4b2981a5-5820-45ec-8873-b193c7bb78d7-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:08:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:11 devstack sudo[82771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:08:11 devstack sudo[82771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:12 devstack sudo[82771]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.773s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Flow 'volume_create_manager' (676546c2-c43a-4489-9993-93bf74f22baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040f65ee-2de0-4745-84de-15193ba22c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040f65ee-2de0-4745-84de-15193ba22c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1099021990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ab756d-5cef-4611-b5a4-c4db3e00a14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1528ad097f224f428b2dc83da2149066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:16Z,use_quota=True,user_id='fda592dbbddd4910b8586d3d1e5d7ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55821f63-199d-4713-80b2-ea1a96347d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55821f63-199d-4713-80b2-ea1a96347d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ef45df-16b9-4d28-b957-a5e420593caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ef45df-16b9-4d28-b957-a5e420593caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ab756d-5cef-4611-b5a4-c4db3e00a14e', 'volume_name': 'volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348ccaef-57f3-4cc5-94ce-19e9d87bfeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348ccaef-57f3-4cc5-94ce-19e9d87bfeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96673e3a-f209-4646-8884-2b9107c26367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:15 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Volume 87ab756d-5cef-4611-b5a4-c4db3e00a14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e', 'volume_size': 1} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1099021990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ab756d-5cef-4611-b5a4-c4db3e00a14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1528ad097f224f428b2dc83da2149066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:16Z,use_quota=True,user_id='fda592dbbddd4910b8586d3d1e5d7ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Creating volume 87ab756d-5cef-4611-b5a4-c4db3e00a14e {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:08:15 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:08:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:15 devstack sudo[82791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e 1073741824 Apr 24 01:08:15 devstack sudo[82791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:16 devstack sudo[82791]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e 1073741824" returned: 0 in 0.836s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:17 devstack sudo[82802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e Apr 24 01:08:17 devstack sudo[82802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5930d81c-5b7b-49af-8d4e-c898d71d635c tempest-BackendsCapabilitiesAdminTestsJSON-1637512122 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6681632995605, 'free_capacity_gb': 1775.6681632995605, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81925) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 01:08:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-89cf10fe-098b-4b59-827f-0ece823494d1 tempest-BackendsCapabilitiesAdminTestsJSON-1637512122 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6681632995605, 'free_capacity_gb': 1775.6681632995605, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81925) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 01:08:18 devstack sudo[82802]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e" returned: 0 in 1.355s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:08:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96673e3a-f209-4646-8884-2b9107c26367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2854b841-dba1-40ea-9612-7ca06d898fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:18 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Volume volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e (87ab756d-5cef-4611-b5a4-c4db3e00a14e): created successfully Apr 24 01:08:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2854b841-dba1-40ea-9612-7ca06d898fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Flow 'volume_create_manager' (676546c2-c43a-4489-9993-93bf74f22baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:18 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5751767f-8200-41e9-a1c0-44b41342cc82 tempest-DeleteServersTestJSON-1216860233 None] Created volume successfully. Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Flow 'volume_create_manager' (7aaf4481-07d2-436d-8143-2bd19b413c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487e90c7-f71a-4d19-bf87-28efceba967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487e90c7-f71a-4d19-bf87-28efceba967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-9399591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9102488-e3aa-4669-b986-9183099a2cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb59abc469e49f9ac47c3729e7c6511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:19Z,use_quota=True,user_id='433a8323eb0b4920b7a582c6f7f3a3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cee6e1d-e0b3-4d90-be84-a747ab5c0680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cee6e1d-e0b3-4d90-be84-a747ab5c0680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135b097b-4e14-4e78-a125-74ce1acfda34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135b097b-4e14-4e78-a125-74ce1acfda34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9102488-e3aa-4669-b986-9183099a2cfa', 'volume_name': 'volume-e9102488-e3aa-4669-b986-9183099a2cfa', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45398f57-7abb-4339-8a20-809f9bc7885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45398f57-7abb-4339-8a20-809f9bc7885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7c5500-3642-4ae5-a48d-7baf9252b228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:19 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Volume e9102488-e3aa-4669-b986-9183099a2cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9102488-e3aa-4669-b986-9183099a2cfa', 'volume_size': 1} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-9399591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9102488-e3aa-4669-b986-9183099a2cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb59abc469e49f9ac47c3729e7c6511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:19Z,use_quota=True,user_id='433a8323eb0b4920b7a582c6f7f3a3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Creating volume e9102488-e3aa-4669-b986-9183099a2cfa {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:08:19 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:08:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:19 devstack sudo[82812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa 1073741824 Apr 24 01:08:19 devstack sudo[82812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:21 devstack sudo[82812]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa 1073741824" returned: 0 in 1.266s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:21 devstack sudo[82825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa Apr 24 01:08:21 devstack sudo[82825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:21 devstack sudo[82825]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa" returned: 0 in 0.691s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7c5500-3642-4ae5-a48d-7baf9252b228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9102488-e3aa-4669-b986-9183099a2cfa', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d170cf5-4f97-4409-b293-3120da05a2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:21 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Volume volume-e9102488-e3aa-4669-b986-9183099a2cfa (e9102488-e3aa-4669-b986-9183099a2cfa): created successfully Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d170cf5-4f97-4409-b293-3120da05a2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Flow 'volume_create_manager' (7aaf4481-07d2-436d-8143-2bd19b413c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b2606662-490f-41d8-b23e-da205179886e tempest-VolumesAdminNegativeTest-1538843579 None] Created volume successfully. Apr 24 01:08:22 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:08:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Flow 'volume_create_manager' (b9dc466f-571d-4fa5-b8fc-91bdc2116c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17693002-8b5f-4c74-83d9-2513bdb9f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17693002-8b5f-4c74-83d9-2513bdb9f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2014602618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f98a4bc-2347-401e-b789-3b3c0987a7df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c546c3d828347b3be5f8bcb44d78ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:23Z,use_quota=True,user_id='1c62ca5802b54f5ba77f8460cfd81068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0045e816-bd48-40f2-b093-b82970a9c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0045e816-bd48-40f2-b093-b82970a9c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad987c5f-e2ad-4134-9635-2cf488bf67e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad987c5f-e2ad-4134-9635-2cf488bf67e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f98a4bc-2347-401e-b789-3b3c0987a7df', 'volume_name': 'volume-9f98a4bc-2347-401e-b789-3b3c0987a7df', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670bf5fa-5f22-4289-a3f6-00727b07636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670bf5fa-5f22-4289-a3f6-00727b07636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1948d1f8-371e-4b38-aa84-17f3ad606a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:23 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Volume 9f98a4bc-2347-401e-b789-3b3c0987a7df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f98a4bc-2347-401e-b789-3b3c0987a7df', 'volume_size': 1} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2014602618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f98a4bc-2347-401e-b789-3b3c0987a7df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c546c3d828347b3be5f8bcb44d78ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:23Z,use_quota=True,user_id='1c62ca5802b54f5ba77f8460cfd81068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Creating volume 9f98a4bc-2347-401e-b789-3b3c0987a7df {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:08:23 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:23 devstack sudo[82829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df 1073741824 Apr 24 01:08:23 devstack sudo[82829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Acquiring lock "cinder-e9102488-e3aa-4669-b986-9183099a2cfa-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Lock "cinder-e9102488-e3aa-4669-b986-9183099a2cfa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Acquiring lock "cinder-quobyte-e9102488-e3aa-4669-b986-9183099a2cfa" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Lock "cinder-quobyte-e9102488-e3aa-4669-b986-9183099a2cfa" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0993ef-0c02-4c8f-a6b2-3ab346bc77aa]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:24 devstack sudo[82835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa Apr 24 01:08:24 devstack sudo[82835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:24 devstack sudo[82829]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df 1073741824" returned: 0 in 1.256s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:24 devstack sudo[82839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df Apr 24 01:08:24 devstack sudo[82839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:25 devstack sudo[82835]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa" returned: 0 in 1.140s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:25 devstack sudo[82845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa Apr 24 01:08:25 devstack sudo[82845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:25 devstack sudo[82845]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e9102488-e3aa-4669-b986-9183099a2cfa" returned: 0 in 0.737s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Lock "cinder-quobyte-e9102488-e3aa-4669-b986-9183099a2cfa" released by "delete_volume" :: held 1.981s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:25 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Created reservations ['d3b35044-cf21-47d1-817e-83ef427a62e0', '7842414a-3201-4846-962e-a22dbaf99ece', '73402c24-95dc-44f9-bb75-b30551b8a5f7', 'a13f1d4e-8dd2-48f8-aa20-dff01995cf03'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:25 devstack sudo[82839]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df" returned: 0 in 1.497s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] <== create_volume: return (2883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:08:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.885s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1948d1f8-371e-4b38-aa84-17f3ad606a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f98a4bc-2347-401e-b789-3b3c0987a7df', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9c85ea-8af0-4ad0-80e5-bfe8cbc7ef97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:26 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Volume volume-9f98a4bc-2347-401e-b789-3b3c0987a7df (9f98a4bc-2347-401e-b789-3b3c0987a7df): created successfully Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9c85ea-8af0-4ad0-80e5-bfe8cbc7ef97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Flow 'volume_create_manager' (b9dc466f-571d-4fa5-b8fc-91bdc2116c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:26 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-9730bf9a-47e9-4ffa-b1c7-8534e065a202 req-0edaf9ef-fed5-4f09-91cb-368dc7ac098d tempest-VolumesGetTestJSON-1891192139 None] Created volume successfully. Apr 24 01:08:26 devstack sudo[82851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:08:26 devstack sudo[82851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Acquiring lock "cinder-9f98a4bc-2347-401e-b789-3b3c0987a7df-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Lock "cinder-9f98a4bc-2347-401e-b789-3b3c0987a7df-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Acquiring lock "cinder-quobyte-9f98a4bc-2347-401e-b789-3b3c0987a7df" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:27 devstack cinder-volume[81925]: WARNING py.warnings [req-ae14f575-45ef-43e8-a8c3-fe0324c9016e req-5ed0308e-f2b6-4c65-9501-b2e2a17a7970 tempest-DeleteServersTestJSON-1216860233 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 24 01:08:27 devstack cinder-volume[81925]: .first() Apr 24 01:08:27 devstack cinder-volume[81925]: Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Lock "cinder-quobyte-9f98a4bc-2347-401e-b789-3b3c0987a7df" acquired by "delete_volume" :: waited 0.133s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-ae14f575-45ef-43e8-a8c3-fe0324c9016e req-5ed0308e-f2b6-4c65-9501-b2e2a17a7970 tempest-DeleteServersTestJSON-1216860233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-ae14f575-45ef-43e8-a8c3-fe0324c9016e req-5ed0308e-f2b6-4c65-9501-b2e2a17a7970 tempest-DeleteServersTestJSON-1216860233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eae05a-4fd1-4f2b-9859-ffd26863b978]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:27 devstack sudo[82851]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e9c3e-f0b0-47e9-86b2-5d92b4ea13c7]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-ae14f575-45ef-43e8-a8c3-fe0324c9016e req-5ed0308e-f2b6-4c65-9501-b2e2a17a7970 tempest-DeleteServersTestJSON-1216860233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.877s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:27 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:08:27 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Deleted volume successfully. Apr 24 01:08:28 devstack sudo[82910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df Apr 24 01:08:28 devstack sudo[82910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13629d49-f409-498a-8738-1c900a6d9f67 tempest-VolumesAdminNegativeTest-1538843579 None] Lock "cinder-e9102488-e3aa-4669-b986-9183099a2cfa-delete_volume" released by "delete_volume" :: held 4.271s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:28 devstack sudo[82912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e Apr 24 01:08:28 devstack sudo[82912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:28 devstack sudo[82912]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-ae14f575-45ef-43e8-a8c3-fe0324c9016e req-5ed0308e-f2b6-4c65-9501-b2e2a17a7970 tempest-DeleteServersTestJSON-1216860233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e" returned: 0 in 0.863s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-ae14f575-45ef-43e8-a8c3-fe0324c9016e req-5ed0308e-f2b6-4c65-9501-b2e2a17a7970 tempest-DeleteServersTestJSON-1216860233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.902s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:28 devstack sudo[82910]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df" returned: 0 in 0.941s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:28 devstack sudo[82936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df Apr 24 01:08:28 devstack sudo[82936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-ae14f575-45ef-43e8-a8c3-fe0324c9016e req-5ed0308e-f2b6-4c65-9501-b2e2a17a7970 tempest-DeleteServersTestJSON-1216860233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b', 'name': 'volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99053a22-53f3-4398-b44d-9c39c57a4c72', 'enforce_multipath': True} {{(pid=81925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 01:08:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-ae14f575-45ef-43e8-a8c3-fe0324c9016e req-5ed0308e-f2b6-4c65-9501-b2e2a17a7970 tempest-DeleteServersTestJSON-1216860233 None] attachment_update completed successfully. Apr 24 01:08:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-33deecf8-a1e4-4f9a-b3ef-129d21a5c7aa tempest-GroupsV314Test-1222131050 None] Group tempest-GroupsV314Test-Group-1457957353: creating Apr 24 01:08:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-33deecf8-a1e4-4f9a-b3ef-129d21a5c7aa tempest-GroupsV314Test-1222131050 None] Group tempest-GroupsV314Test-Group-1457957353: created successfully Apr 24 01:08:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-33deecf8-a1e4-4f9a-b3ef-129d21a5c7aa tempest-GroupsV314Test-1222131050 None] Create group completed successfully. Apr 24 01:08:29 devstack sudo[82936]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9f98a4bc-2347-401e-b789-3b3c0987a7df" returned: 0 in 0.674s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Lock "cinder-quobyte-9f98a4bc-2347-401e-b789-3b3c0987a7df" released by "delete_volume" :: held 1.727s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG cinder.quota [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Created reservations ['c75ad651-7efe-4d1e-a4bc-6b6087989b69', '0f25de64-8f02-4b27-a7a6-dd79d156b8ea', '6768bcc5-22c2-4ce5-ae6f-a4ed3065abf9', '9d1ee233-a89f-402a-9e7e-403134644cf1'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:29 devstack sudo[83009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:08:29 devstack sudo[83009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:30 devstack sudo[83009]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.506s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.manager [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:08:30 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Deleted volume successfully. Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-390d3661-f102-4043-b373-8a514f513b34 req-2c0118f3-d433-409e-88b7-496d62795a4e tempest-VolumesGetTestJSON-1891192139 None] Lock "cinder-9f98a4bc-2347-401e-b789-3b3c0987a7df-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Flow 'volume_create_manager' (27c2d8e2-eccf-4cb8-8723-fffe6ff2e4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4096dd81-e947-4417-836f-afb74fd2ecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4096dd81-e947-4417-836f-afb74fd2ecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-678112114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ef72113-ea32-44c5-9c7d-87a361188ab8,host='devstack@QuobyteHD#QuobyteHD',id=936fba42-4d3f-4c17-865c-4382ed131a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65517918ad5d4c8cb6c960f7411167c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:31Z,use_quota=True,user_id='b2409d6a916e40a7967bf3c0909e5a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(753f565f-564a-41ad-be75-f78082c73a34),volume_type_id=753f565f-564a-41ad-be75-f78082c73a34)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f23bba-40e1-4708-8f87-4fbd8aa985de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f23bba-40e1-4708-8f87-4fbd8aa985de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ba5245-07ef-4990-aa51-0c746cf0fce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ba5245-07ef-4990-aa51-0c746cf0fce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936fba42-4d3f-4c17-865c-4382ed131a05', 'volume_name': 'volume-936fba42-4d3f-4c17-865c-4382ed131a05', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15961142-5f0a-41ee-a059-85a408e6ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15961142-5f0a-41ee-a059-85a408e6ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023de14a-41f8-4ae2-8c4d-26d8feeddd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:30 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Volume 936fba42-4d3f-4c17-865c-4382ed131a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936fba42-4d3f-4c17-865c-4382ed131a05', 'volume_size': 1} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ef72113-ea32-44c5-9c7d-87a361188ab8,created_at=2026-04-23T23:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-678112114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ef72113-ea32-44c5-9c7d-87a361188ab8,host='devstack@QuobyteHD#QuobyteHD',id=936fba42-4d3f-4c17-865c-4382ed131a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65517918ad5d4c8cb6c960f7411167c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:31Z,use_quota=True,user_id='b2409d6a916e40a7967bf3c0909e5a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(753f565f-564a-41ad-be75-f78082c73a34),volume_type_id=753f565f-564a-41ad-be75-f78082c73a34)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Creating volume 936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:08:30 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:08:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:30 devstack sudo[83340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 1073741824 Apr 24 01:08:30 devstack sudo[83340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:31 devstack sudo[83340]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 1073741824" returned: 0 in 0.783s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:31 devstack sudo[83345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 Apr 24 01:08:31 devstack sudo[83345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:32 devstack sudo[83345]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:32 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:08:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023de14a-41f8-4ae2-8c4d-26d8feeddd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936fba42-4d3f-4c17-865c-4382ed131a05', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4563707-2bd9-4a71-af66-bf5ddb203e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:32 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Volume volume-936fba42-4d3f-4c17-865c-4382ed131a05 (936fba42-4d3f-4c17-865c-4382ed131a05): created successfully Apr 24 01:08:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4563707-2bd9-4a71-af66-bf5ddb203e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Flow 'volume_create_manager' (27c2d8e2-eccf-4cb8-8723-fffe6ff2e4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:32 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-38cabc23-974b-44b2-b5dd-7d56b75f27fe tempest-GroupsV314Test-1222131050 None] Created volume successfully. Apr 24 01:08:34 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5857094c-1ebf-4393-8968-52edfae9eaeb tempest-GroupSnapshotsV319Test-1280042305 None] Group tempest-GroupSnapshotsV319Test-Group-510167656: creating Apr 24 01:08:34 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5857094c-1ebf-4393-8968-52edfae9eaeb tempest-GroupSnapshotsV319Test-1280042305 None] Group tempest-GroupSnapshotsV319Test-Group-510167656: created successfully Apr 24 01:08:34 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5857094c-1ebf-4393-8968-52edfae9eaeb tempest-GroupSnapshotsV319Test-1280042305 None] Create group completed successfully. Apr 24 01:08:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:34 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Cloning volume 936fba42-4d3f-4c17-865c-4382ed131a05 to volume cb456edc-7357-42bc-b83f-467591fc3667 Apr 24 01:08:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Creating offline snapshot faf5ab19-567f-41d5-a6c4-22581c826e19 of volume 936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:08:34 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ae99eb-059f-42ac-a59a-5f5b342e6c8f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:34 devstack sudo[83348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 Apr 24 01:08:34 devstack sudo[83348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:34 devstack sudo[83348]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05" returned: 0 in 0.586s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:35 devstack sudo[83354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 1G Apr 24 01:08:35 devstack sudo[83354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:35 devstack sudo[83354]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 1G" returned: 0 in 0.793s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936fba42-4d3f-4c17-865c-4382ed131a05 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:35 devstack sudo[83369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936fba42-4d3f-4c17-865c-4382ed131a05 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 Apr 24 01:08:35 devstack sudo[83369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Flow 'volume_create_manager' (1bfedfae-bd42-43dd-bcdb-54c4fc0c4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e360d7-03d0-4baa-9ed4-a6cf26917844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e360d7-03d0-4baa-9ed4-a6cf26917844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258112685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b83fdcb-244c-4515-8b46-c83a8d295686,host='devstack@QuobyteHD#QuobyteHD',id=95efc88f-544c-4690-9f02-1156c2851e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ee87f6de524b8bbef7d7e10092d1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:36Z,use_quota=True,user_id='fdc3fc083f5a499fa3d3191f8c9bcb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d737cd7-51c7-4e9f-adce-8f70e54de00e),volume_type_id=2d737cd7-51c7-4e9f-adce-8f70e54de00e)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124e4658-193a-4204-8373-39809bc36fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124e4658-193a-4204-8373-39809bc36fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759214db-82fe-4071-a224-62a71ef6f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759214db-82fe-4071-a224-62a71ef6f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95efc88f-544c-4690-9f02-1156c2851e4f', 'volume_name': 'volume-95efc88f-544c-4690-9f02-1156c2851e4f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53f1e5f-c4d4-41f4-8644-8c1ea1d68173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53f1e5f-c4d4-41f4-8644-8c1ea1d68173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61287172-0248-4c31-81f5-729667c034d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:36 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Volume 95efc88f-544c-4690-9f02-1156c2851e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95efc88f-544c-4690-9f02-1156c2851e4f', 'volume_size': 1} Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:36 devstack sudo[83369]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936fba42-4d3f-4c17-865c-4382ed131a05 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19" returned: 0 in 0.893s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:36 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:08:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:36 devstack sudo[83397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 Apr 24 01:08:36 devstack sudo[83397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:37 devstack sudo[83397]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19" returned: 0 in 0.591s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:37 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=3,cinder:SELECT=48 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:08:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:37 devstack sudo[83427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.info Apr 24 01:08:37 devstack sudo[83427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:37 devstack sudo[83427]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.info" returned: 0 in 0.494s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:37 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:08:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:37 devstack sudo[83431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.info Apr 24 01:08:37 devstack sudo[83431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:38 devstack sudo[83431]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.info" returned: 0 in 0.587s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Acquiring lock "cinder-quobyte-cb456edc-7357-42bc-b83f-467591fc3667" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Lock "cinder-quobyte-cb456edc-7357-42bc-b83f-467591fc3667" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] snapshot: faf5ab19-567f-41d5-a6c4-22581c826e19, volume: cb456edc-7357-42bc-b83f-467591fc3667, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b06e48-9593-421d-acd1-9accc1d10950]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:38 devstack sudo[83444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 Apr 24 01:08:38 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:39 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19" returned: 0 in 0.544s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-936fba42-4d3f-4c17-865c-4382ed131a05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bcae20-fdca-4638-910b-da35c52ada73]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:39 devstack sudo[83449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 Apr 24 01:08:39 devstack sudo[83449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=51,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=6 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:08:39 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-efdb0c53-9e4f-4bf0-b5e3-ab69ef238354 req-4e6f7895-211a-4a03-9db3-d876471e0514 tempest-DeleteServersTestJSON-1216860233 None] Terminate volume connection completed successfully. Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-efdb0c53-9e4f-4bf0-b5e3-ab69ef238354 req-4e6f7895-211a-4a03-9db3-d876471e0514 tempest-DeleteServersTestJSON-1216860233 None] Deleting attachment 99053a22-53f3-4398-b44d-9c39c57a4c72. {{(pid=81925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 01:08:39 devstack sudo[83449]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05" returned: 0 in 0.588s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:08:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:39 devstack sudo[83454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 Apr 24 01:08:39 devstack sudo[83454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Acquiring lock "cinder-87ab756d-5cef-4611-b5a4-c4db3e00a14e-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Lock "cinder-87ab756d-5cef-4611-b5a4-c4db3e00a14e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Acquiring lock "cinder-quobyte-87ab756d-5cef-4611-b5a4-c4db3e00a14e" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Lock "cinder-quobyte-87ab756d-5cef-4611-b5a4-c4db3e00a14e" acquired by "delete_volume" :: waited 0.058s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:44 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c45001c-2cef-48ca-a1b5-6ed403411917]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:44 devstack sudo[83485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e Apr 24 01:08:44 devstack sudo[83485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:45 devstack sudo[83454]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667" returned: 0 in 6.159s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:45 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9fcd5f-3c09-4ad7-adfa-55d2444b7168]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:45 devstack sudo[83485]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e" returned: 0 in 1.406s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:45 devstack sudo[83493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e Apr 24 01:08:45 devstack sudo[83493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:45 devstack sudo[83491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 Apr 24 01:08:45 devstack sudo[83491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:46 devstack sudo[83493]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87ab756d-5cef-4611-b5a4-c4db3e00a14e" returned: 0 in 0.575s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Lock "cinder-quobyte-87ab756d-5cef-4611-b5a4-c4db3e00a14e" released by "delete_volume" :: held 2.061s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Created reservations ['60689b8f-06e9-4919-b9cb-dabddc1f0600', '9a191981-8ee5-4a6e-b502-a636c6d41fd7', '71dc8b07-2444-46d8-977a-5c73ffd8b464', '7bdefbb3-4609-4fe9-be0f-a5b456c80221'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:46 devstack sudo[83491]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05" returned: 0 in 0.744s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:08:46 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Converted 1024.00 MB image at 166.20 MB/s Apr 24 01:08:46 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:46 devstack sudo[83500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 Apr 24 01:08:46 devstack sudo[83500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:46 devstack sudo[83502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:08:46 devstack sudo[83502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:47 devstack sudo[83502]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.481s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:08:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Deleted volume successfully. Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3fa3b8d2-c31e-4027-9698-f593f8ae8f0b tempest-DeleteServersTestJSON-1216860233 None] Lock "cinder-87ab756d-5cef-4611-b5a4-c4db3e00a14e-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:47 devstack sudo[83500]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667" returned: 0 in 0.572s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Lock "cinder-quobyte-cb456edc-7357-42bc-b83f-467591fc3667" released by "_copy_volume_from_snapshot" :: held 8.705s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Acquiring lock "cinder-quobyte-faf5ab19-567f-41d5-a6c4-22581c826e19" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Lock "cinder-quobyte-faf5ab19-567f-41d5-a6c4-22581c826e19" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Deleting offline snapshot faf5ab19-567f-41d5-a6c4-22581c826e19 of volume 936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] snapshot_file for this snap is: volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c330a59-0626-40a9-807b-6e3f9b1a04bc]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:47 devstack sudo[83508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 Apr 24 01:08:47 devstack sudo[83508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:47 devstack sudo[83508]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19" returned: 0 in 0.649s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-936fba42-4d3f-4c17-865c-4382ed131a05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec2896c-4314-4828-96d7-b3ffd2d1ae54]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:48 devstack sudo[83513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 Apr 24 01:08:48 devstack sudo[83513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:48 devstack sudo[83513]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05" returned: 0 in 0.598s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:48 devstack sudo[83518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 Apr 24 01:08:48 devstack sudo[83518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:49 devstack sudo[83518]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19" returned: 0 in 0.605s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:49 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19 Apr 24 01:08:49 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:49 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05.faf5ab19-567f-41d5-a6c4-22581c826e19" returned: 0 in 0.569s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Lock "cinder-quobyte-faf5ab19-567f-41d5-a6c4-22581c826e19" released by "_delete_snapshot" :: held 2.520s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.442s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.356s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2b83fdcb-244c-4515-8b46-c83a8d295686,created_at=2026-04-23T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258112685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b83fdcb-244c-4515-8b46-c83a8d295686,host='devstack@QuobyteHD#QuobyteHD',id=95efc88f-544c-4690-9f02-1156c2851e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ee87f6de524b8bbef7d7e10092d1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:08:36Z,use_quota=True,user_id='fdc3fc083f5a499fa3d3191f8c9bcb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d737cd7-51c7-4e9f-adce-8f70e54de00e),volume_type_id=2d737cd7-51c7-4e9f-adce-8f70e54de00e)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Creating volume 95efc88f-544c-4690-9f02-1156c2851e4f {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:08:49 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:08:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:49 devstack sudo[83528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f 1073741824 Apr 24 01:08:49 devstack sudo[83528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:49 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-78b35059-72b3-446f-add6-2968fb56f758 tempest-GroupsV314Test-1222131050 None] Create group from source-group-0ef72113-ea32-44c5-9c7d-87a361188ab8 completed successfully. Apr 24 01:08:50 devstack sudo[83528]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f 1073741824" returned: 0 in 0.852s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:50 devstack sudo[83533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f Apr 24 01:08:50 devstack sudo[83533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Acquiring lock "cinder-quobyte-cb456edc-7357-42bc-b83f-467591fc3667" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Lock "cinder-quobyte-cb456edc-7357-42bc-b83f-467591fc3667" acquired by "delete_volume" :: waited 0.030s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc0c6c-401e-43d2-8357-371338542617]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:51 devstack sudo[83535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 Apr 24 01:08:51 devstack sudo[83535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:51 devstack sudo[83533]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f" returned: 0 in 0.778s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61287172-0248-4c31-81f5-729667c034d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95efc88f-544c-4690-9f02-1156c2851e4f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a45d84b-27aa-4f46-88a8-fe0e1f793368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:08:51 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Volume volume-95efc88f-544c-4690-9f02-1156c2851e4f (95efc88f-544c-4690-9f02-1156c2851e4f): created successfully Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a45d84b-27aa-4f46-88a8-fe0e1f793368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Flow 'volume_create_manager' (1bfedfae-bd42-43dd-bcdb-54c4fc0c4386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:08:51 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-28d6477a-4955-4350-a3df-c50d3e00eabd tempest-GroupSnapshotsV319Test-1280042305 None] Created volume successfully. Apr 24 01:08:51 devstack sudo[83535]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667" returned: 0 in 0.807s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:51 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667 Apr 24 01:08:51 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:52 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cb456edc-7357-42bc-b83f-467591fc3667" returned: 0 in 0.696s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Lock "cinder-quobyte-cb456edc-7357-42bc-b83f-467591fc3667" released by "delete_volume" :: held 1.553s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Created reservations ['a970ba02-ff4a-4f1e-994f-a8c0929877c8'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:52 devstack cinder-volume[81925]: WARNING cinder.quota [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1409602333 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1409602333, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:08:52 devstack cinder-volume[81925]: WARNING cinder.quota [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1409602333 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1409602333, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:08:52 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] GroupSnapshot 138bfdbb-63d9-43ff-90cf-ad4211e786bb: creating. Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Group snapshot 138bfdbb-63d9-43ff-90cf-ad4211e786bb: creating. {{(pid=81925) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Creating offline snapshot 86b092b9-5cea-4c8f-803c-48f1c280d581 of volume 95efc88f-544c-4690-9f02-1156c2851e4f {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Created reservations ['ef56f4ac-9395-4f9f-b1f1-95a91d6225f1', '699ef101-1778-4189-815d-cfec5d7521cb', 'd51e49b9-e582-4f4f-9934-7cfd19328682', '58378597-5982-4883-b4e2-0a778f3c3e56'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c548b0a-381f-4c3b-86a5-7025a011d085]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:52 devstack sudo[83546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f Apr 24 01:08:52 devstack sudo[83546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:52 devstack sudo[83548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:08:52 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:53 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.518s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:53 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:08:53 devstack sudo[83546]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:53 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ad3fd7df-8a0d-4e68-9580-67423525ebd7 tempest-GroupsV314Test-1222131050 None] Delete group completed successfully. Apr 24 01:08:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f" returned: 0 in 0.674s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:53 devstack sudo[83554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 1G Apr 24 01:08:53 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:53 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Acquiring lock "cinder-quobyte-936fba42-4d3f-4c17-865c-4382ed131a05" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:53 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Lock "cinder-quobyte-936fba42-4d3f-4c17-865c-4382ed131a05" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:53 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7065f5a-9f37-46cc-a8ea-6f6a90d174fe]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:54 devstack sudo[83556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 Apr 24 01:08:54 devstack sudo[83556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:54 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 1G" returned: 0 in 0.826s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95efc88f-544c-4690-9f02-1156c2851e4f -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:54 devstack sudo[83561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95efc88f-544c-4690-9f02-1156c2851e4f -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 Apr 24 01:08:54 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:54 devstack sudo[83556]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05" returned: 0 in 0.677s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:54 devstack sudo[83567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05 Apr 24 01:08:54 devstack sudo[83567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:55 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95efc88f-544c-4690-9f02-1156c2851e4f -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581" returned: 0 in 0.769s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:55 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:55 devstack sudo[83572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 Apr 24 01:08:55 devstack sudo[83572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:55 devstack sudo[83567]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-936fba42-4d3f-4c17-865c-4382ed131a05" returned: 0 in 0.658s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Lock "cinder-quobyte-936fba42-4d3f-4c17-865c-4382ed131a05" released by "delete_volume" :: held 1.437s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Created reservations ['e2f4bbfc-1447-4509-88e7-1fa280c9aa1b'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Created reservations ['0b7060fe-19e8-4216-b62b-f989f16c03c9', 'b50aefd9-8bef-4768-b402-f1d8fdd57476', '922b507a-2869-411b-8c29-a0041299f6ad', 'cb1193ec-4375-499a-9112-e447cfcf0659'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:55 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:08:55 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:55 devstack sudo[83572]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581" returned: 0 in 0.643s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:55 devstack sudo[83578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.info Apr 24 01:08:55 devstack sudo[83578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:56 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.575s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:56 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:08:56 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4f290980-347b-44c6-a050-7fa0ee794076 tempest-GroupsV314Test-1222131050 None] Delete group completed successfully. Apr 24 01:08:56 devstack sudo[83578]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.info" returned: 0 in 0.690s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:56 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:08:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:56 devstack sudo[83582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.info Apr 24 01:08:56 devstack sudo[83582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:57 devstack sudo[83582]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.info" returned: 0 in 0.556s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.286s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:08:57 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c51c1ee8-a4f2-49e6-9335-c0df67121c36 tempest-GroupSnapshotsV319Test-1280042305 None] group_snapshot 138bfdbb-63d9-43ff-90cf-ad4211e786bb: created successfully Apr 24 01:08:58 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] group_snapshot 138bfdbb-63d9-43ff-90cf-ad4211e786bb: deleting Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] group_snapshot 138bfdbb-63d9-43ff-90cf-ad4211e786bb: deleting {{(pid=81925) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Acquiring lock "cinder-quobyte-95efc88f-544c-4690-9f02-1156c2851e4f" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Lock "cinder-quobyte-95efc88f-544c-4690-9f02-1156c2851e4f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Acquiring lock "cinder-quobyte-86b092b9-5cea-4c8f-803c-48f1c280d581" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Lock "cinder-quobyte-86b092b9-5cea-4c8f-803c-48f1c280d581" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Deleting offline snapshot 86b092b9-5cea-4c8f-803c-48f1c280d581 of volume 95efc88f-544c-4690-9f02-1156c2851e4f {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] snapshot_file for this snap is: volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c1faac-055b-40e3-9bef-3a2c82e36300]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:58 devstack sudo[83586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 Apr 24 01:08:58 devstack sudo[83586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:59 devstack sudo[83586]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581" returned: 0 in 0.611s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95efc88f-544c-4690-9f02-1156c2851e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:08:59 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b61a6-1f2a-4049-9be0-1c0d6f06c765]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:08:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:59 devstack sudo[83591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f Apr 24 01:08:59 devstack sudo[83591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:08:59 devstack sudo[83591]: pam_unix(sudo:session): session closed for user root Apr 24 01:08:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f" returned: 0 in 0.743s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:08:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:08:59 devstack sudo[83596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 Apr 24 01:08:59 devstack sudo[83596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:00 devstack sudo[83596]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581" returned: 0 in 0.611s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:00 devstack sudo[83601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581 Apr 24 01:09:00 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:01 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f.86b092b9-5cea-4c8f-803c-48f1c280d581" returned: 0 in 0.580s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Lock "cinder-quobyte-86b092b9-5cea-4c8f-803c-48f1c280d581" released by "_delete_snapshot" :: held 2.652s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Lock "cinder-quobyte-95efc88f-544c-4690-9f02-1156c2851e4f" released by "delete_snapshot" :: held 2.673s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:01 devstack cinder-volume[81925]: WARNING cinder.quota [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-766549388 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-766549388, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:09:01 devstack cinder-volume[81925]: WARNING cinder.quota [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-766549388 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-766549388, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:09:01 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] Created reservations ['b4dd8aae-8e5a-4eac-a380-2414386b2d83', 'd03865e8-e41a-41c5-8bf6-dff90c91751b', 'c3b44e70-894d-4dfd-9a8c-5ef0b1e6475a', '5aed8863-4f44-4df8-b995-3105fa002db7'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:09:01 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e6d8b5cf-0295-4b78-8f69-24283542897e tempest-GroupSnapshotsV319Test-1280042305 None] group_snapshot 138bfdbb-63d9-43ff-90cf-ad4211e786bb: deleted successfully Apr 24 01:09:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Acquiring lock "cinder-quobyte-95efc88f-544c-4690-9f02-1156c2851e4f" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Lock "cinder-quobyte-95efc88f-544c-4690-9f02-1156c2851e4f" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:01 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ebf768-24dd-47f4-95e4-24d6a2ce5105]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:09:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:02 devstack sudo[83604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f Apr 24 01:09:02 devstack sudo[83604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:02 devstack sudo[83604]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f" returned: 0 in 0.692s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:02 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f Apr 24 01:09:02 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:03 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-95efc88f-544c-4690-9f02-1156c2851e4f" returned: 0 in 0.551s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Lock "cinder-quobyte-95efc88f-544c-4690-9f02-1156c2851e4f" released by "delete_volume" :: held 1.336s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Created reservations ['6fed2199-d7d9-46dc-9565-ed2971fc429b'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:09:03 devstack cinder-volume[81925]: WARNING cinder.quota [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-766549388 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-766549388, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Created reservations ['ca05ba4e-b750-4b24-ae68-552006e1af89', 'db4bca01-80bc-4c6e-ac22-1c54a4d2e184', '4ca4bb2c-dae7-45fd-aaa0-396ef016e56c', '0017943e-c87d-4235-8f33-dc1d41da79e5'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:03 devstack sudo[83612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:09:03 devstack sudo[83612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:04 devstack sudo[83612]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.691s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:04 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:09:04 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a6cffa7e-edd8-4ec3-bd0f-bd95f459d263 tempest-GroupSnapshotsV319Test-1280042305 None] Delete group completed successfully. Apr 24 01:09:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:09:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:11 devstack sudo[83662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:09:11 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:12 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.946s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:09:13 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=54,cinder:UPDATE=49,cinder:DELETE=1,cinder:INSERT=10 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:09:13 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=44,cinder:UPDATE=60,cinder:INSERT=15,cinder:DELETE=1 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Flow 'volume_create_manager' (3ab3dd83-0aeb-4967-9e65-0f6af8423b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8daf6f2-c180-4f83-9d55-ad64aaf507bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8daf6f2-c180-4f83-9d55-ad64aaf507bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-210343877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb661f6f-5fb7-477d-8b15-2830d2c67b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f870167f42884fe1b046d39a5ecaf175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:19Z,use_quota=True,user_id='49817897ef4c493d9a8fb953a6de5cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4c9b3d-b2fd-42e1-9711-29bbdab27333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4c9b3d-b2fd-42e1-9711-29bbdab27333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62090cf1-8abf-4c00-8905-4536b1e98c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62090cf1-8abf-4c00-8905-4536b1e98c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb661f6f-5fb7-477d-8b15-2830d2c67b4b', 'volume_name': 'volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb72f67-f2ee-40a1-9ed1-0f210ae0bb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb72f67-f2ee-40a1-9ed1-0f210ae0bb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7e2b96-40cf-4635-8947-48f37d556416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:18 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Volume fb661f6f-5fb7-477d-8b15-2830d2c67b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b', 'volume_size': 1} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-210343877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb661f6f-5fb7-477d-8b15-2830d2c67b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f870167f42884fe1b046d39a5ecaf175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:19Z,use_quota=True,user_id='49817897ef4c493d9a8fb953a6de5cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Creating volume fb661f6f-5fb7-477d-8b15-2830d2c67b4b {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:09:18 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:09:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:18 devstack sudo[83711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b 1073741824 Apr 24 01:09:18 devstack sudo[83711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:20 devstack sudo[83711]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b 1073741824" returned: 0 in 1.102s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:20 devstack sudo[83719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b Apr 24 01:09:20 devstack sudo[83719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:20 devstack sudo[83719]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b" returned: 0 in 0.841s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7e2b96-40cf-4635-8947-48f37d556416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6003899-4ac4-4a88-ac44-f49d56b3fe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:20 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Volume volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b (fb661f6f-5fb7-477d-8b15-2830d2c67b4b): created successfully Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6003899-4ac4-4a88-ac44-f49d56b3fe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Flow 'volume_create_manager' (3ab3dd83-0aeb-4967-9e65-0f6af8423b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ca91359c-41a1-4a7f-9fe3-ca82e57faf4b tempest-VolumeQuotasAdminTestJSON-1036109423 None] Created volume successfully. Apr 24 01:09:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Acquiring lock "cinder-fb661f6f-5fb7-477d-8b15-2830d2c67b4b-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "cinder-fb661f6f-5fb7-477d-8b15-2830d2c67b4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Acquiring lock "cinder-quobyte-fb661f6f-5fb7-477d-8b15-2830d2c67b4b" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "cinder-quobyte-fb661f6f-5fb7-477d-8b15-2830d2c67b4b" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:22 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a390a66-b060-458c-afa4-2db132d5d51c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:09:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:22 devstack sudo[83743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b Apr 24 01:09:22 devstack sudo[83743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:22 devstack sudo[83743]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b" returned: 0 in 0.652s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:22 devstack sudo[83754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b Apr 24 01:09:22 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:23 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb661f6f-5fb7-477d-8b15-2830d2c67b4b" returned: 0 in 0.625s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "cinder-quobyte-fb661f6f-5fb7-477d-8b15-2830d2c67b4b" released by "delete_volume" :: held 1.338s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Created reservations ['4df34560-9242-41d4-99a5-a6a1e36caaf1', 'cd5c1870-5829-48ab-84ed-5475f9c6353c', 'ba0c87df-5ead-44ae-be21-3df43da53123', '11a90e7a-499a-4d83-8c5f-c8bc46865c3e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:23 devstack sudo[83763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:09:23 devstack sudo[83763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:24 devstack sudo[83763]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.647s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:09:24 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Deleted volume successfully. Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7bbd6363-e366-451f-818e-f10c55611357 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "cinder-fb661f6f-5fb7-477d-8b15-2830d2c67b4b-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Flow 'volume_create_manager' (0fd4dd4a-8545-4f8c-a1d8-981f3be5336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2e4265-a4f6-44a5-9925-5905c1b40bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2e4265-a4f6-44a5-9925-5905c1b40bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-123557917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4680c76c-af7e-4833-bc02-7b7f28d6e6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f870167f42884fe1b046d39a5ecaf175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:25Z,use_quota=True,user_id='49817897ef4c493d9a8fb953a6de5cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc3d12d-5aa9-4274-a536-cb6dc6f9e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc3d12d-5aa9-4274-a536-cb6dc6f9e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fdab26-d0cb-49ec-b8ce-5133723531b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fdab26-d0cb-49ec-b8ce-5133723531b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4680c76c-af7e-4833-bc02-7b7f28d6e6be', 'volume_name': 'volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9535fb-ea40-42f7-a3fe-7b6ba25a4ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9535fb-ea40-42f7-a3fe-7b6ba25a4ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43b4047-7866-498a-904a-00bf1354f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Volume 4680c76c-af7e-4833-bc02-7b7f28d6e6be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be', 'volume_size': 1} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-123557917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4680c76c-af7e-4833-bc02-7b7f28d6e6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f870167f42884fe1b046d39a5ecaf175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:25Z,use_quota=True,user_id='49817897ef4c493d9a8fb953a6de5cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Creating volume 4680c76c-af7e-4833-bc02-7b7f28d6e6be {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:09:25 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:09:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:25 devstack sudo[83818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be 1073741824 Apr 24 01:09:25 devstack sudo[83818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:26 devstack sudo[83818]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be 1073741824" returned: 0 in 1.011s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:26 devstack sudo[83837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be Apr 24 01:09:26 devstack sudo[83837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:26 devstack sudo[83837]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be" returned: 0 in 0.717s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43b4047-7866-498a-904a-00bf1354f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b61e2c-3057-46fe-8e43-50b7a7eb0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:26 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Volume volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be (4680c76c-af7e-4833-bc02-7b7f28d6e6be): created successfully Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b61e2c-3057-46fe-8e43-50b7a7eb0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Flow 'volume_create_manager' (0fd4dd4a-8545-4f8c-a1d8-981f3be5336e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:26 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-620e85dd-a705-4b1a-a84c-db24bb44ca24 tempest-VolumeQuotasAdminTestJSON-1036109423 None] Created volume successfully. Apr 24 01:09:27 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b72ebed0-ba36-4833-886c-2167d143c278 tempest-VolumeQuotasAdminTestJSON-656187862 None] Transfer volume completed successfully. Apr 24 01:09:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Acquiring lock "cinder-4680c76c-af7e-4833-bc02-7b7f28d6e6be-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Lock "cinder-4680c76c-af7e-4833-bc02-7b7f28d6e6be-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Acquiring lock "cinder-quobyte-4680c76c-af7e-4833-bc02-7b7f28d6e6be" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Lock "cinder-quobyte-4680c76c-af7e-4833-bc02-7b7f28d6e6be" acquired by "delete_volume" :: waited 0.039s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:29 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa05f1-62c5-499b-a32a-e914c2ef980a]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:09:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:30 devstack sudo[83939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be Apr 24 01:09:30 devstack sudo[83939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:31 devstack sudo[83939]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be" returned: 0 in 1.658s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:31 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be Apr 24 01:09:31 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:32 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4680c76c-af7e-4833-bc02-7b7f28d6e6be" returned: 0 in 0.859s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Lock "cinder-quobyte-4680c76c-af7e-4833-bc02-7b7f28d6e6be" released by "delete_volume" :: held 2.642s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Created reservations ['c868a884-3921-4f63-a27e-8e83c3cd8a7d', 'b149eee7-a7f5-4ec6-9181-2e7ebd2d14a0', '94ec4fcf-488d-4f36-bd3e-98ffccba349b', '1031c4a0-ed40-4b8b-a1cc-23e0d9ce96a8'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:32 devstack sudo[83955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:09:32 devstack sudo[83955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:34 devstack sudo[83955]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.239s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:34 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:09:34 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Deleted volume successfully. Apr 24 01:09:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d2f78f6-5b9a-429a-a36e-d588335b9805 tempest-VolumeQuotasAdminTestJSON-897189808 None] Lock "cinder-4680c76c-af7e-4833-bc02-7b7f28d6e6be-delete_volume" released by "delete_volume" :: held 4.625s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:42 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=17,cinder:UPDATE=20,cinder:INSERT=5 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:09:44 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=24,cinder:SELECT=12,cinder:DELETE=4,cinder:INSERT=5 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Flow 'volume_create_manager' (1f76b2da-446a-42bc-aa04-8160c69e5700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35db6618-e69a-479b-ae15-064b2d1ed38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35db6618-e69a-479b-ae15-064b2d1ed38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-914412642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6a9e83-7533-449d-ac8a-72fc4381741d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91853aab55f44f8d98232d267491d1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:49Z,use_quota=True,user_id='a3a2224437b941a8915ecd2cd6eb77dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c1d60b-9e8b-48bf-a5d3-d3ad70be5d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c1d60b-9e8b-48bf-a5d3-d3ad70be5d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee73c5af-309e-4f54-b3c7-137416e78502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee73c5af-309e-4f54-b3c7-137416e78502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6a9e83-7533-449d-ac8a-72fc4381741d', 'volume_name': 'volume-ad6a9e83-7533-449d-ac8a-72fc4381741d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c968c4e-f893-4e7a-8866-614109b2e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c968c4e-f893-4e7a-8866-614109b2e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20224feb-fa83-4c85-b246-8cc987429300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Volume ad6a9e83-7533-449d-ac8a-72fc4381741d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6a9e83-7533-449d-ac8a-72fc4381741d', 'volume_size': 1} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-914412642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6a9e83-7533-449d-ac8a-72fc4381741d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91853aab55f44f8d98232d267491d1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:49Z,use_quota=True,user_id='a3a2224437b941a8915ecd2cd6eb77dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Creating volume ad6a9e83-7533-449d-ac8a-72fc4381741d {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:09:49 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Flow 'volume_create_manager' (3b1f0330-152c-4dc7-a0a7-f6cc44d56f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b154bb89-a253-4703-bdf0-c6539dfdb578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b154bb89-a253-4703-bdf0-c6539dfdb578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-203623877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8012989-44a7-48d4-bf67-3f228f1e30df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add5e8d11ea649d68b2d68c1867c6157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:49Z,use_quota=True,user_id='877abd44156e49358726c05cc893dd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a522f4ab-4207-48d5-97be-f3a103320e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a522f4ab-4207-48d5-97be-f3a103320e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:49 devstack sudo[84194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d 1073741824 Apr 24 01:09:49 devstack sudo[84194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab96fa1-e7fe-40a2-86ce-8bd174313b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab96fa1-e7fe-40a2-86ce-8bd174313b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8012989-44a7-48d4-bf67-3f228f1e30df', 'volume_name': 'volume-b8012989-44a7-48d4-bf67-3f228f1e30df', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac3faa6-72da-40d8-8df4-bd724b9e4e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac3faa6-72da-40d8-8df4-bd724b9e4e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c603f223-a8ae-4c31-9820-ce78b5ca8380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:49 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Volume b8012989-44a7-48d4-bf67-3f228f1e30df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8012989-44a7-48d4-bf67-3f228f1e30df', 'volume_size': 1} Apr 24 01:09:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:50 devstack sudo[84194]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d 1073741824" returned: 0 in 1.154s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:50 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d Apr 24 01:09:50 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Flow 'volume_create_manager' (ad1a3a7a-cfda-4738-80a3-9c2009687549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d1f537-90ba-4568-86f5-0b714d110f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d1f537-90ba-4568-86f5-0b714d110f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1880993948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a847ec-dd2e-4ddd-b1cb-3744caf85410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7823eea9bab54882822d2b3d37ca558d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:51Z,use_quota=True,user_id='26716c02fefa4a1e832df9aeb055fd1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8288dfa7-2da4-43fa-b08a-263d4ace5ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8288dfa7-2da4-43fa-b08a-263d4ace5ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adbae79-fdcf-44c9-8985-77a7848f0c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adbae79-fdcf-44c9-8985-77a7848f0c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a847ec-dd2e-4ddd-b1cb-3744caf85410', 'volume_name': 'volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18da5626-21d0-4822-a6fc-daf4b80cbb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18da5626-21d0-4822-a6fc-daf4b80cbb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbd09c1-d535-432d-94e8-93e510596c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:50 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Volume c2a847ec-dd2e-4ddd-b1cb-3744caf85410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410', 'volume_size': 1} Apr 24 01:09:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:51 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d" returned: 0 in 0.774s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.834s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-203623877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8012989-44a7-48d4-bf67-3f228f1e30df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add5e8d11ea649d68b2d68c1867c6157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:49Z,use_quota=True,user_id='877abd44156e49358726c05cc893dd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Creating volume b8012989-44a7-48d4-bf67-3f228f1e30df {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:09:51 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20224feb-fa83-4c85-b246-8cc987429300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6a9e83-7533-449d-ac8a-72fc4381741d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b924ad2d-b5d0-4245-8e41-6407f8a30621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:51 devstack sudo[84227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df 1073741824 Apr 24 01:09:51 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:51 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Volume volume-ad6a9e83-7533-449d-ac8a-72fc4381741d (ad6a9e83-7533-449d-ac8a-72fc4381741d): created successfully Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b924ad2d-b5d0-4245-8e41-6407f8a30621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Flow 'volume_create_manager' (1f76b2da-446a-42bc-aa04-8160c69e5700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:51 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d449908e-b9c8-444b-9a14-557780ff7bbb tempest-ServerRescueNegativeTestJSON-932928159 None] Created volume successfully. Apr 24 01:09:52 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df 1073741824" returned: 0 in 0.977s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:52 devstack sudo[84237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df Apr 24 01:09:52 devstack sudo[84237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:52 devstack sudo[84237]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df" returned: 0 in 0.530s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1880993948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a847ec-dd2e-4ddd-b1cb-3744caf85410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7823eea9bab54882822d2b3d37ca558d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:09:51Z,use_quota=True,user_id='26716c02fefa4a1e832df9aeb055fd1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Creating volume c2a847ec-dd2e-4ddd-b1cb-3744caf85410 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:09:52 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:09:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c603f223-a8ae-4c31-9820-ce78b5ca8380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8012989-44a7-48d4-bf67-3f228f1e30df', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7f9ab5-f226-4d66-8f9b-265c9f248065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:53 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Volume volume-b8012989-44a7-48d4-bf67-3f228f1e30df (b8012989-44a7-48d4-bf67-3f228f1e30df): created successfully Apr 24 01:09:53 devstack sudo[84240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 1073741824 Apr 24 01:09:53 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7f9ab5-f226-4d66-8f9b-265c9f248065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Flow 'volume_create_manager' (3b1f0330-152c-4dc7-a0a7-f6cc44d56f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:53 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2e18ac6a-9be8-457c-81a3-eeefd1e221d9 tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Created volume successfully. Apr 24 01:09:54 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 1073741824" returned: 0 in 1.083s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:54 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 Apr 24 01:09:54 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:54 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410" returned: 0 in 0.781s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbd09c1-d535-432d-94e8-93e510596c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1098984-d097-444d-8e3a-ae5198330ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:09:54 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Volume volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 (c2a847ec-dd2e-4ddd-b1cb-3744caf85410): created successfully Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1098984-d097-444d-8e3a-ae5198330ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:09:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Flow 'volume_create_manager' (ad1a3a7a-cfda-4738-80a3-9c2009687549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:09:54 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4cd3073e-4e4d-4af9-a177-ef942fa3ed71 tempest-VolumesServicesTestJSON-1352227454 None] Created volume successfully. Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Acquiring lock "cinder-b8012989-44a7-48d4-bf67-3f228f1e30df-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "cinder-b8012989-44a7-48d4-bf67-3f228f1e30df-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Acquiring lock "cinder-quobyte-b8012989-44a7-48d4-bf67-3f228f1e30df" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "cinder-quobyte-b8012989-44a7-48d4-bf67-3f228f1e30df" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80a9f2b-65f0-45bb-8306-8359b15be09c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Acquiring lock "cinder-c2a847ec-dd2e-4ddd-b1cb-3744caf85410-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:55 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df Apr 24 01:09:55 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Lock "cinder-c2a847ec-dd2e-4ddd-b1cb-3744caf85410-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Acquiring lock "cinder-quobyte-c2a847ec-dd2e-4ddd-b1cb-3744caf85410" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Lock "cinder-quobyte-c2a847ec-dd2e-4ddd-b1cb-3744caf85410" acquired by "delete_volume" :: waited 0.027s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d08acbf-e8c2-40e0-b5cf-e9b1fdde8c8a]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:09:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:55 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 Apr 24 01:09:55 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:56 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df" returned: 0 in 0.838s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:56 devstack sudo[84257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df Apr 24 01:09:56 devstack sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:56 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410" returned: 0 in 1.017s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:56 devstack sudo[84271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410 Apr 24 01:09:56 devstack sudo[84271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:56 devstack sudo[84257]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8012989-44a7-48d4-bf67-3f228f1e30df" returned: 0 in 0.757s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "cinder-quobyte-b8012989-44a7-48d4-bf67-3f228f1e30df" released by "delete_volume" :: held 1.839s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Created reservations ['80892cc0-5252-4a50-be51-aea0cd5ed58f', 'c664e8a1-44eb-4ad0-894e-846e27a16028', 'b53f9393-d149-4f19-8cb3-1d61a7e671bf', '040194ed-b788-48cb-8e92-9cddcc02cf72'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:09:57 devstack sudo[84271]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c2a847ec-dd2e-4ddd-b1cb-3744caf85410" returned: 0 in 0.930s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Lock "cinder-quobyte-c2a847ec-dd2e-4ddd-b1cb-3744caf85410" released by "delete_volume" :: held 2.030s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:57 devstack sudo[84293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:09:57 devstack sudo[84293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Created reservations ['81843a3f-672d-45c4-9abc-7cb27d24c451', '59514205-1956-4ab4-aac5-a21560771ccb', '565014bd-c202-4cb3-aba4-e26fbe5e9ff3', '0dd96be4-42a6-4f45-85b6-44606c89b2b8'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:09:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:09:58 devstack sudo[84295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:09:58 devstack sudo[84295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:09:59 devstack sudo[84295]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.750s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:59 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:09:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Deleted volume successfully. Apr 24 01:09:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ed09b944-6ff5-4f90-b6a0-9bfb2cc94d24 tempest-VolumesServicesTestJSON-1352227454 None] Lock "cinder-c2a847ec-dd2e-4ddd-b1cb-3744caf85410-delete_volume" released by "delete_volume" :: held 4.395s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:09:59 devstack sudo[84293]: pam_unix(sudo:session): session closed for user root Apr 24 01:09:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 2.172s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:09:59 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:09:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Deleted volume successfully. Apr 24 01:09:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df2e0177-bde9-432a-96ea-a9ee1071382d tempest-VolumeQuotasNegativeTestJSON-1165733874 None] Lock "cinder-b8012989-44a7-48d4-bf67-3f228f1e30df-delete_volume" released by "delete_volume" :: held 4.786s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Flow 'volume_create_manager' (c330e0d9-40cc-47a8-ac92-55e7e9696178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720b981d-f979-40a4-8197-e3d8ab26b83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720b981d-f979-40a4-8197-e3d8ab26b83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:59Z,deleted=False,deleted_at=None,display_description='',display_name='f3273727-b51e-401a-91d3-aed5303ef124-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e834477d-c542-4dbd-a2fd-80b41cc99664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003767d3c8451a88ea140b94e39ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:00Z,use_quota=True,user_id='0df28b7e90c9416db3ce908c473dd1e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edb9dd8-67e4-4e83-a322-23ca51d548ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edb9dd8-67e4-4e83-a322-23ca51d548ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650b8603-0f04-4449-9a1b-464389965fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650b8603-0f04-4449-9a1b-464389965fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e834477d-c542-4dbd-a2fd-80b41cc99664', 'volume_name': 'volume-e834477d-c542-4dbd-a2fd-80b41cc99664', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0bc477-cdd2-4d6f-9813-671266eba921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0bc477-cdd2-4d6f-9813-671266eba921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd8d601-9069-4af8-8267-26774e79c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:00 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Volume e834477d-c542-4dbd-a2fd-80b41cc99664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e834477d-c542-4dbd-a2fd-80b41cc99664', 'volume_size': 1} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:09:59Z,deleted=False,deleted_at=None,display_description='',display_name='f3273727-b51e-401a-91d3-aed5303ef124-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e834477d-c542-4dbd-a2fd-80b41cc99664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003767d3c8451a88ea140b94e39ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:00Z,use_quota=True,user_id='0df28b7e90c9416db3ce908c473dd1e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Creating volume e834477d-c542-4dbd-a2fd-80b41cc99664 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:00 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:00 devstack sudo[84349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 1073741824 Apr 24 01:10:00 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:01 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 1073741824" returned: 0 in 1.042s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:01 devstack sudo[84358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 Apr 24 01:10:01 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:01 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd8d601-9069-4af8-8267-26774e79c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e834477d-c542-4dbd-a2fd-80b41cc99664', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb276d5-4cf3-4b55-9ab7-017805a6dfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:02 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Volume volume-e834477d-c542-4dbd-a2fd-80b41cc99664 (e834477d-c542-4dbd-a2fd-80b41cc99664): created successfully Apr 24 01:10:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb276d5-4cf3-4b55-9ab7-017805a6dfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Flow 'volume_create_manager' (c330e0d9-40cc-47a8-ac92-55e7e9696178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-d0483142-402a-420a-9c93-91f241e098fc tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Created volume successfully. Apr 24 01:10:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-288ae2eb-1e90-4505-842b-7a03469bbaae tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-288ae2eb-1e90-4505-842b-7a03469bbaae tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:07 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f55843-7a19-49d1-94eb-14ff4765cbb7]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-288ae2eb-1e90-4505-842b-7a03469bbaae tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:07 devstack sudo[84454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 Apr 24 01:10:07 devstack sudo[84454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:08 devstack sudo[84454]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-288ae2eb-1e90-4505-842b-7a03469bbaae tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664" returned: 0 in 0.798s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-288ae2eb-1e90-4505-842b-7a03469bbaae tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.820s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:08 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-288ae2eb-1e90-4505-842b-7a03469bbaae tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b', 'name': 'volume-e834477d-c542-4dbd-a2fd-80b41cc99664', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b60489c8-dc14-49b2-8c96-ab0088d341aa', 'enforce_multipath': True} {{(pid=81925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 01:10:08 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-a8289ecb-b68c-4e5d-b4ae-03d0c2396aff req-288ae2eb-1e90-4505-842b-7a03469bbaae tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] attachment_update completed successfully. Apr 24 01:10:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:10:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:11 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:10:11 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:12 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.849s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:10:18 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=5 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:10:18 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=3 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:10:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Acquiring lock "cinder-ad6a9e83-7533-449d-ac8a-72fc4381741d-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:10:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "cinder-ad6a9e83-7533-449d-ac8a-72fc4381741d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:10:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Acquiring lock "cinder-quobyte-ad6a9e83-7533-449d-ac8a-72fc4381741d" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:10:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "cinder-quobyte-ad6a9e83-7533-449d-ac8a-72fc4381741d" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:10:20 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4134c103-0d4d-4dbc-98e8-c0769ddc6fb4]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:20 devstack sudo[84991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d Apr 24 01:10:20 devstack sudo[84991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:21 devstack sudo[84991]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d" returned: 0 in 0.773s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:21 devstack sudo[84997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d Apr 24 01:10:21 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:21 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ad6a9e83-7533-449d-ac8a-72fc4381741d" returned: 0 in 0.701s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "cinder-quobyte-ad6a9e83-7533-449d-ac8a-72fc4381741d" released by "delete_volume" :: held 1.535s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:21 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Created reservations ['a09bb8ea-660f-44d0-9663-014965539412', '15f7b6f2-b627-4857-8b1c-82bf069a1918', '08e8a9df-81a7-45f3-81f3-4e3087030a00', '919445ed-5575-443b-8f0d-98284b66c977'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:10:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:22 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:10:22 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:23 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.059s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:23 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:10:23 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Deleted volume successfully. Apr 24 01:10:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-744b7453-673f-4328-8ed4-4d6bd4bd46fb tempest-ServerRescueNegativeTestJSON-932928159 None] Lock "cinder-ad6a9e83-7533-449d-ac8a-72fc4381741d-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Flow 'volume_create_manager' (92728908-0f74-4138-8b45-dc942233d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575bb6c3-f4d1-4306-b87f-052029b47a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575bb6c3-f4d1-4306-b87f-052029b47a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1731796281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8d9702-4b65-4416-b9c3-4223644326de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0af97df80ce4846ba492e27f7a6853f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:26Z,use_quota=True,user_id='f2feaf66b3c142eca603edbdd357df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcd55c85-bfd1-4297-94ad-c752e1fc7fe9),volume_type_id=bcd55c85-bfd1-4297-94ad-c752e1fc7fe9)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a5ce5e-e84b-44d1-90e8-f6044e4ca5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a5ce5e-e84b-44d1-90e8-f6044e4ca5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61194c4c-5c66-4b82-983a-8377293ce51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61194c4c-5c66-4b82-983a-8377293ce51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8d9702-4b65-4416-b9c3-4223644326de', 'volume_name': 'volume-ea8d9702-4b65-4416-b9c3-4223644326de', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47094bc9-7da4-4223-be19-e7ea43f0f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47094bc9-7da4-4223-be19-e7ea43f0f25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f02995-eb82-4a0d-8104-5d6c6acd82b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Volume ea8d9702-4b65-4416-b9c3-4223644326de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8d9702-4b65-4416-b9c3-4223644326de', 'volume_size': 1} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1731796281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8d9702-4b65-4416-b9c3-4223644326de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0af97df80ce4846ba492e27f7a6853f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:26Z,use_quota=True,user_id='f2feaf66b3c142eca603edbdd357df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcd55c85-bfd1-4297-94ad-c752e1fc7fe9),volume_type_id=bcd55c85-bfd1-4297-94ad-c752e1fc7fe9)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Creating volume ea8d9702-4b65-4416-b9c3-4223644326de {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:25 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:25 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de 1073741824 Apr 24 01:10:25 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:26 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de 1073741824" returned: 0 in 1.074s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:27 devstack sudo[85046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de Apr 24 01:10:27 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:27 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de" returned: 0 in 0.541s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f02995-eb82-4a0d-8104-5d6c6acd82b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8d9702-4b65-4416-b9c3-4223644326de', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f7c011-7648-4d24-bed4-83ec302bae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:27 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Volume volume-ea8d9702-4b65-4416-b9c3-4223644326de (ea8d9702-4b65-4416-b9c3-4223644326de): created successfully Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f7c011-7648-4d24-bed4-83ec302bae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Flow 'volume_create_manager' (92728908-0f74-4138-8b45-dc942233d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:27 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-542dcf20-71c8-4d82-877b-23d63c87e28e tempest-VolumeTypesAccessTest-1349819056 None] Created volume successfully. Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Acquiring lock "cinder-ea8d9702-4b65-4416-b9c3-4223644326de-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:10:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Lock "cinder-ea8d9702-4b65-4416-b9c3-4223644326de-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:10:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Acquiring lock "cinder-quobyte-ea8d9702-4b65-4416-b9c3-4223644326de" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:10:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Lock "cinder-quobyte-ea8d9702-4b65-4416-b9c3-4223644326de" acquired by "delete_volume" :: waited 0.082s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:10:28 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cc19b1-2d7c-4e23-af03-97c86a132aa4]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:28 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de Apr 24 01:10:28 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:29 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de" returned: 0 in 1.243s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:29 devstack sudo[85078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de Apr 24 01:10:29 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:30 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea8d9702-4b65-4416-b9c3-4223644326de" returned: 0 in 0.939s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Lock "cinder-quobyte-ea8d9702-4b65-4416-b9c3-4223644326de" released by "delete_volume" :: held 2.306s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:30 devstack cinder-volume[81925]: WARNING cinder.quota [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1100314645 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1100314645, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:10:30 devstack cinder-volume[81925]: WARNING cinder.quota [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1100314645 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1100314645, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Created reservations ['2cd907bd-dc29-48d2-8446-6bb2f22b3006', '768e688a-0918-4722-872a-eea857c2576e', '26944e67-af18-441e-a4cf-232b878452ac', 'a566a2eb-5543-4c6f-b88c-1319800bb15f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:30 devstack sudo[85099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:10:30 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:31 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.808s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:31 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:10:31 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Deleted volume successfully. Apr 24 01:10:31 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cff173d0-eb1e-4038-aa07-3adfd123bc4e tempest-VolumeTypesAccessTest-1349819056 None] Lock "cinder-ea8d9702-4b65-4416-b9c3-4223644326de-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Flow 'volume_create_manager' (148fd73d-be60-4073-854a-acd7e46c76bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d517ed5d-181a-4b83-be22-17a0406f488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d517ed5d-181a-4b83-be22-17a0406f488b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-938629471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af868844-c6c9-408a-8f66-402e0471ffa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0454758009574fb7ae0b0d7648a2af77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:37Z,use_quota=True,user_id='5b523a11744c41388bc04220c1103841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7984cd1f-06b5-42ae-a721-fc44b38ceffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7984cd1f-06b5-42ae-a721-fc44b38ceffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bc84aa-ee12-41f7-a723-83191928bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bc84aa-ee12-41f7-a723-83191928bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af868844-c6c9-408a-8f66-402e0471ffa7', 'volume_name': 'volume-af868844-c6c9-408a-8f66-402e0471ffa7', 'volume_size': 2}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f3d9d0-13f3-4170-ba05-f6712a1d8e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f3d9d0-13f3-4170-ba05-f6712a1d8e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8563409c-2c41-4639-a6df-8ad012c9de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:36 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Volume af868844-c6c9-408a-8f66-402e0471ffa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af868844-c6c9-408a-8f66-402e0471ffa7', 'volume_size': 2} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-938629471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af868844-c6c9-408a-8f66-402e0471ffa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0454758009574fb7ae0b0d7648a2af77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:37Z,use_quota=True,user_id='5b523a11744c41388bc04220c1103841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Creating volume af868844-c6c9-408a-8f66-402e0471ffa7 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:36 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 2147483648 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:36 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 2147483648 Apr 24 01:10:36 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:37 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 2147483648" returned: 0 in 1.057s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:37 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 Apr 24 01:10:37 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:38 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7" returned: 0 in 0.749s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8563409c-2c41-4639-a6df-8ad012c9de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af868844-c6c9-408a-8f66-402e0471ffa7', 'volume_size': 2}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08a601d-4cc4-47ae-b0c2-28db5db7c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:38 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Volume volume-af868844-c6c9-408a-8f66-402e0471ffa7 (af868844-c6c9-408a-8f66-402e0471ffa7): created successfully Apr 24 01:10:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08a601d-4cc4-47ae-b0c2-28db5db7c552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Flow 'volume_create_manager' (148fd73d-be60-4073-854a-acd7e46c76bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:38 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1b609628-1ff3-42c1-b7e9-929c489a993d tempest-VolumesCloneNegativeTest-2117032942 None] Created volume successfully. Apr 24 01:10:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Acquiring lock "cinder-af868844-c6c9-408a-8f66-402e0471ffa7-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:10:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Lock "cinder-af868844-c6c9-408a-8f66-402e0471ffa7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:10:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Acquiring lock "cinder-quobyte-af868844-c6c9-408a-8f66-402e0471ffa7" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:10:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Lock "cinder-quobyte-af868844-c6c9-408a-8f66-402e0471ffa7" acquired by "delete_volume" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:10:39 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f1e8a5-345e-4154-b939-b9c325bee017]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:39 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 Apr 24 01:10:39 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:40 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7" returned: 0 in 0.933s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:40 devstack sudo[85262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7 Apr 24 01:10:40 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:41 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af868844-c6c9-408a-8f66-402e0471ffa7" returned: 0 in 0.911s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Lock "cinder-quobyte-af868844-c6c9-408a-8f66-402e0471ffa7" released by "delete_volume" :: held 1.929s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Created reservations ['760b0f04-d77e-4a89-b960-771981bd5acb', '2df4fc2c-d788-467f-8306-d13d09b1b146', '89e022b5-0db7-4af1-84a7-e536ab068dd6', '0e72db19-35fd-4eb4-a66e-7b976d77c450'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:41 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:10:41 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:42 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.362s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:42 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:10:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Deleted volume successfully. Apr 24 01:10:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2dcb44d7-34ce-4e11-a61c-dccbda9845f1 tempest-VolumesCloneNegativeTest-2117032942 None] Lock "cinder-af868844-c6c9-408a-8f66-402e0471ffa7-delete_volume" released by "delete_volume" :: held 3.627s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Flow 'volume_create_manager' (c5ff2279-ecea-4510-ae96-0ae9812f5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e061652-d032-4179-9fa8-8b7b8976c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e061652-d032-4179-9fa8-8b7b8976c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-245638206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1490032c-80e8-4408-a5c1-adebf043e92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b71e9546d4779a72c1d2ca2d7904a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:44Z,use_quota=True,user_id='6421ff006e9a4a6490175a97f4e4ec87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b7e1b3-7bfd-4243-a46e-2ebaf1f6509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b7e1b3-7bfd-4243-a46e-2ebaf1f6509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9df715b-51e7-43f9-8684-8ce39aa1d734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9df715b-51e7-43f9-8684-8ce39aa1d734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1490032c-80e8-4408-a5c1-adebf043e92b', 'volume_name': 'volume-1490032c-80e8-4408-a5c1-adebf043e92b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2ebf74-b9e1-4e22-bd29-6a2ceda55861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2ebf74-b9e1-4e22-bd29-6a2ceda55861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bed09ef-e4c1-4eb2-991c-5b1de98aaaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:44 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Volume 1490032c-80e8-4408-a5c1-adebf043e92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1490032c-80e8-4408-a5c1-adebf043e92b', 'volume_size': 1} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-245638206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1490032c-80e8-4408-a5c1-adebf043e92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b71e9546d4779a72c1d2ca2d7904a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:44Z,use_quota=True,user_id='6421ff006e9a4a6490175a97f4e4ec87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Creating volume 1490032c-80e8-4408-a5c1-adebf043e92b {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:44 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:44 devstack sudo[85270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b 1073741824 Apr 24 01:10:44 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:45 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b 1073741824" returned: 0 in 1.138s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:45 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b Apr 24 01:10:45 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:46 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b" returned: 0 in 0.967s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bed09ef-e4c1-4eb2-991c-5b1de98aaaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1490032c-80e8-4408-a5c1-adebf043e92b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cef32ac-60d0-4cdd-bbd0-58fca0d1d940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:46 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Volume volume-1490032c-80e8-4408-a5c1-adebf043e92b (1490032c-80e8-4408-a5c1-adebf043e92b): created successfully Apr 24 01:10:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cef32ac-60d0-4cdd-bbd0-58fca0d1d940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Flow 'volume_create_manager' (c5ff2279-ecea-4510-ae96-0ae9812f5619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:46 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-cb2cb603-3e08-4e8d-9f17-d47fc5b14627 tempest-AbsoluteLimitsTests-1391884939 None] Created volume successfully. Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Flow 'volume_create_manager' (6fd07435-e169-44b6-9e63-672c3d4747fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ce2965-8d49-4f05-b190-42733048b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ce2965-8d49-4f05-b190-42733048b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1397495125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0585de0-e34b-4e58-9fb9-9b79099e8107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299357656f394368aeacc82fc5f52f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:47Z,use_quota=True,user_id='704e03dc305d49d38617c31628bfd32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38aa39b-5c3b-415f-88f7-363fd506fb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38aa39b-5c3b-415f-88f7-363fd506fb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a455e137-06e7-41c6-a7a5-0cf82ea38b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.image.glance [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Creating Keystone auth plugin from conf {{(pid=81925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Acquiring lock "cinder-1490032c-80e8-4408-a5c1-adebf043e92b-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Lock "cinder-1490032c-80e8-4408-a5c1-adebf043e92b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Acquiring lock "cinder-quobyte-1490032c-80e8-4408-a5c1-adebf043e92b" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Lock "cinder-quobyte-1490032c-80e8-4408-a5c1-adebf043e92b" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd61ee3e-d5e6-431e-963d-aafb51fcebce]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:47 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b Apr 24 01:10:47 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a455e137-06e7-41c6-a7a5-0cf82ea38b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0585de0-e34b-4e58-9fb9-9b79099e8107', 'volume_name': 'volume-b0585de0-e34b-4e58-9fb9-9b79099e8107', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b7b003-c68c-4e4b-8beb-2fb48872d165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b7b003-c68c-4e4b-8beb-2fb48872d165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be1f30e-c82e-44e2-a91c-d9d0831d5898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:48 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Volume b0585de0-e34b-4e58-9fb9-9b79099e8107: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0585de0-e34b-4e58-9fb9-9b79099e8107', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 01:10:48 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Trying to clone b0585de0-e34b-4e58-9fb9-9b79099e8107 from image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]). {{(pid=81925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 01:10:48 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 01:10:48 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Image download 20.69 MB at 20.69 MB/s Apr 24 01:10:48 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[122bfe9a-965d-4057-85f1-191e60219890]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:49 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b" returned: 0 in 1.301s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:49 devstack sudo[85382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b Apr 24 01:10:49 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:49 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD Apr 24 01:10:49 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:50 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1490032c-80e8-4408-a5c1-adebf043e92b" returned: 0 in 1.004s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Lock "cinder-quobyte-1490032c-80e8-4408-a5c1-adebf043e92b" released by "delete_volume" :: held 2.416s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Created reservations ['deb55db6-a357-4ddf-a400-48054f2e2589', '636a0fd0-6d01-4957-955b-3b8084386ad9', '1b6c6eb1-4b97-4ac0-be5b-02e6284a57e9', '376eb549-2e66-49b7-9d51-ce1863ef4fbf'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:50 devstack sudo[85405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:10:50 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:50 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Flow 'volume_create_manager' (c48a6a50-0662-4306-9828-4643a334a00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bb8a24-853d-4d55-9a3b-2fb84bfed4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD" returned: 0 in 1.462s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Temporary image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 is fetched for user 704e03dc305d49d38617c31628bfd32c. {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bb8a24-853d-4d55-9a3b-2fb84bfed4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1948167487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6b0e03-a846-4796-a787-0a3bb9fd5a05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08cff2ae804c451087c65c5e423b48fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:50Z,use_quota=True,user_id='b39a10502217480fa655b7700b6e94d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be515e36-2b3d-4d12-b66b-c28b79e6f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be515e36-2b3d-4d12-b66b-c28b79e6f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3848533b-dc73-4440-b96b-74ed52409b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3848533b-dc73-4440-b96b-74ed52409b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6b0e03-a846-4796-a787-0a3bb9fd5a05', 'volume_name': 'volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5d6d6b-e4fe-4282-9ee4-9027314f04d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5d6d6b-e4fe-4282-9ee4-9027314f04d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b230cb-b439-425f-8ef6-dcc555f2e3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:50 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Volume ea6b0e03-a846-4796-a787-0a3bb9fd5a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05', 'volume_size': 1} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1948167487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6b0e03-a846-4796-a787-0a3bb9fd5a05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08cff2ae804c451087c65c5e423b48fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:50Z,use_quota=True,user_id='b39a10502217480fa655b7700b6e94d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Creating volume ea6b0e03-a846-4796-a787-0a3bb9fd5a05 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:50 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:50 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 1073741824 Apr 24 01:10:50 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa70947-09f0-4d10-9899-a25bb92ab4af]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:50 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD Apr 24 01:10:50 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:50 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.534s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:10:50 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Deleted volume successfully. Apr 24 01:10:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e1807edf-2fb6-4562-8df5-93685c4ba348 tempest-AbsoluteLimitsTests-1391884939 None] Lock "cinder-1490032c-80e8-4408-a5c1-adebf043e92b-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:10:51 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:51 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 1073741824" returned: 0 in 0.849s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:51 devstack sudo[85421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 Apr 24 01:10:51 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:51 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05" returned: 0 in 0.582s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1397495125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0585de0-e34b-4e58-9fb9-9b79099e8107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299357656f394368aeacc82fc5f52f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:47Z,use_quota=True,user_id='704e03dc305d49d38617c31628bfd32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Creating volume b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:51 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:51 devstack sudo[85424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 1073741824 Apr 24 01:10:51 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b230cb-b439-425f-8ef6-dcc555f2e3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f4538a-48e5-4d5f-b794-d4ad062617ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:52 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Volume volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 (ea6b0e03-a846-4796-a787-0a3bb9fd5a05): created successfully Apr 24 01:10:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f4538a-48e5-4d5f-b794-d4ad062617ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Flow 'volume_create_manager' (c48a6a50-0662-4306-9828-4643a334a00f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:52 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-900182d6-e0fd-4ba0-870d-a641520528fb tempest-VolumesTestJSON-1091769665 None] Created volume successfully. Apr 24 01:10:52 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 1073741824" returned: 0 in 0.978s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:53 devstack sudo[85435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:10:53 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Flow 'volume_create_manager' (ef0c4090-6de5-489c-abc9-db498da5f2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cdb045-e453-49e7-829d-e4da7872a29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cdb045-e453-49e7-829d-e4da7872a29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1035525979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4521523-5ad7-42f4-9bdf-433812ec0e2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08cff2ae804c451087c65c5e423b48fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:53Z,use_quota=True,user_id='b39a10502217480fa655b7700b6e94d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18105716-46be-43b2-ab34-f9992aed2e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18105716-46be-43b2-ab34-f9992aed2e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121e1a2e-7da8-4a43-8e4b-531961d44664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121e1a2e-7da8-4a43-8e4b-531961d44664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4521523-5ad7-42f4-9bdf-433812ec0e2f', 'volume_name': 'volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7a7fed-8276-470e-8caf-a17033f48d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7a7fed-8276-470e-8caf-a17033f48d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c5f07a-559c-4ef4-91f1-a853e1d547b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:53 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Volume b4521523-5ad7-42f4-9bdf-433812ec0e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f', 'volume_size': 1} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:53 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 0 in 0.592s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1035525979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4521523-5ad7-42f4-9bdf-433812ec0e2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08cff2ae804c451087c65c5e423b48fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:53Z,use_quota=True,user_id='b39a10502217480fa655b7700b6e94d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Creating volume b4521523-5ad7-42f4-9bdf-433812ec0e2f {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:53 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:53 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f 1073741824 Apr 24 01:10:53 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Attempting download of a7c3cef6-73f5-4af2-9de8-0bc5792d6063 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}])) to volume b0585de0-e34b-4e58-9fb9-9b79099e8107. {{(pid=81925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[92be8e71-a891-45b4-98d5-ce6abd101fe2]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_oh3kna93 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:53 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_oh3kna93 Apr 24 01:10:53 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:54 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f 1073741824" returned: 0 in 0.816s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:54 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_oh3kna93" returned: 0 in 0.747s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_oh3kna93 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:54 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f Apr 24 01:10:54 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:54 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_oh3kna93 Apr 24 01:10:54 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:55 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:55 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_oh3kna93" returned: 1 in 0.569s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_oh3kna93' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf61a16-9827-4979-b8cc-93d395a8dcf0]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f" returned: 0 in 0.617s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c5f07a-559c-4ef4-91f1-a853e1d547b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339cdccd-041c-4b55-a958-e30b06f2a9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:55 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Volume volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f (b4521523-5ad7-42f4-9bdf-433812ec0e2f): created successfully Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339cdccd-041c-4b55-a958-e30b06f2a9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Flow 'volume_create_manager' (ef0c4090-6de5-489c-abc9-db498da5f2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-38a53387-f9c9-4d54-81c0-81cfa73cca6d tempest-VolumesTestJSON-1091769665 None] Created volume successfully. Apr 24 01:10:55 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD Apr 24 01:10:55 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:55 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD" returned: 0 in 0.631s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] a7c3cef6-73f5-4af2-9de8-0bc5792d6063 was qcow2, converting to raw {{(pid=81925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 01:10:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:55 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:10:55 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Flow 'volume_create_manager' (cf896f0f-1187-411e-bf96-ce3bd18ed8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1d96e0-b50c-432c-a777-408153c41f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1d96e0-b50c-432c-a777-408153c41f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1843689236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f1de31-ba2a-4fc2-8854-08e17a8a2d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bf746f9ee045c8b22c29a68627f98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:56Z,use_quota=True,user_id='f7b1d42166e0463497a95f6d2c38c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b59db82-3099-4041-aef9-4a6854c37d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b59db82-3099-4041-aef9-4a6854c37d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d66ed58-48ba-47fd-b41e-3af7698bf537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d66ed58-48ba-47fd-b41e-3af7698bf537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f1de31-ba2a-4fc2-8854-08e17a8a2d39', 'volume_name': 'volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614894df-7f53-4fd2-8fc5-7c00746fc99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614894df-7f53-4fd2-8fc5-7c00746fc99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ff85de-0b00-4901-bd80-ba79ced30325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:56 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Volume e2f1de31-ba2a-4fc2-8854-08e17a8a2d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39', 'volume_size': 1} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1843689236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f1de31-ba2a-4fc2-8854-08e17a8a2d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bf746f9ee045c8b22c29a68627f98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:56Z,use_quota=True,user_id='f7b1d42166e0463497a95f6d2c38c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Creating volume e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:56 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:56 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 1073741824 Apr 24 01:10:56 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:10:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Flow 'volume_create_manager' (b9415a88-36c7-4bdd-bb7b-8c2e7d990f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d49113c-6a65-4839-8069-5e3306b76401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d49113c-6a65-4839-8069-5e3306b76401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-552396393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a21feb-d595-48bf-b5e9-70feaf6dfdfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08cff2ae804c451087c65c5e423b48fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:57Z,use_quota=True,user_id='b39a10502217480fa655b7700b6e94d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1730760a-f391-4cf0-a416-fece672c959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1730760a-f391-4cf0-a416-fece672c959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90a57b9-25b3-4523-b4ab-edfca9f85cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90a57b9-25b3-4523-b4ab-edfca9f85cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a21feb-d595-48bf-b5e9-70feaf6dfdfa', 'volume_name': 'volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf2fa4d-3544-4f4c-9e4c-b3ff6687e421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf2fa4d-3544-4f4c-9e4c-b3ff6687e421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad02fa39-e744-4d5f-bebc-a174170b1cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:57 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Volume d3a21feb-d595-48bf-b5e9-70feaf6dfdfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa', 'volume_size': 1} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:57 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 1073741824" returned: 0 in 1.007s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:57 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 Apr 24 01:10:57 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:57 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 0 in 2.002s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_auki_n_edevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:10:57 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Converted 112.00 MB image at 55.82 MB/s Apr 24 01:10:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:57 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 1G Apr 24 01:10:57 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:58 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" returned: 0 in 0.749s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-552396393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a21feb-d595-48bf-b5e9-70feaf6dfdfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08cff2ae804c451087c65c5e423b48fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:10:57Z,use_quota=True,user_id='b39a10502217480fa655b7700b6e94d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Creating volume d3a21feb-d595-48bf-b5e9-70feaf6dfdfa {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:10:58 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:58 devstack sudo[85478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa 1073741824 Apr 24 01:10:58 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ff85de-0b00-4901-bd80-ba79ced30325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd9041b-96b2-49dc-bcc4-c806b8c3ac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:58 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Volume volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 (e2f1de31-ba2a-4fc2-8854-08e17a8a2d39): created successfully Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd9041b-96b2-49dc-bcc4-c806b8c3ac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Flow 'volume_create_manager' (cf896f0f-1187-411e-bf96-ce3bd18ed8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:58 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f9aef7d1-a4c2-4153-8244-44ead78fff17 tempest-VolumesDeleteCascade-1029263106 None] Created volume successfully. Apr 24 01:10:58 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 1G" returned: 0 in 0.783s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[66916b51-9cd1-4b72-96c8-ebb56956225d]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:58 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:10:58 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:10:59 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa 1073741824" returned: 0 in 1.035s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:59 devstack sudo[85499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa Apr 24 01:10:59 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:59 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 0 in 0.801s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:59 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:10:59 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:10:59 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa" returned: 0 in 0.644s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.165s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Creating offline snapshot c39de7d7-24b2-4b57-8577-ef7a5161e6f8 of volume e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf6b65e-e936-435e-b09b-3fa3679f91f8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad02fa39-e744-4d5f-bebc-a174170b1cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02596962-26a6-4ad3-b7b1-ee7534491eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:10:59 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Volume volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa (d3a21feb-d595-48bf-b5e9-70feaf6dfdfa): created successfully Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02596962-26a6-4ad3-b7b1-ee7534491eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:10:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Flow 'volume_create_manager' (b9415a88-36c7-4bdd-bb7b-8c2e7d990f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:10:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-19f9a4a3-5074-48ce-8303-56ade9c985e3 tempest-VolumesTestJSON-1091769665 None] Created volume successfully. Apr 24 01:10:59 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 Apr 24 01:10:59 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:00 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 1 in 0.637s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Downloaded image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}])) to volume b0585de0-e34b-4e58-9fb9-9b79099e8107 successfully. {{(pid=81925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Temporary image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 for user 704e03dc305d49d38617c31628bfd32c is deleted. {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Marking volume b0585de0-e34b-4e58-9fb9-9b79099e8107 as bootable. {{(pid=81925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Copying metadata from image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 to b0585de0-e34b-4e58-9fb9-9b79099e8107. {{(pid=81925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Creating volume glance metadata for volume b0585de0-e34b-4e58-9fb9-9b79099e8107 backed by image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be1f30e-c82e-44e2-a91c-d9d0831d5898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0585de0-e34b-4e58-9fb9-9b79099e8107', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab64138a-943b-4c5d-afe7-f21a84b0e327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:00 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Volume volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 (b0585de0-e34b-4e58-9fb9-9b79099e8107): created successfully Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab64138a-943b-4c5d-afe7-f21a84b0e327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Flow 'volume_create_manager' (6fd07435-e169-44b6-9e63-672c3d4747fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:00 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-682f4171-387d-4ab9-bb3f-6327094af336 tempest-VolumesExtendTest-1400656938 None] Created volume successfully. Apr 24 01:11:00 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" returned: 0 in 0.624s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:00 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 1G Apr 24 01:11:00 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Acquiring lock "cinder-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Lock "cinder-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Acquiring lock "cinder-quobyte-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Lock "cinder-quobyte-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:01 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b986a9-303d-4762-a506-16b47440e79b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:01 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 1G" returned: 0 in 0.895s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:01 devstack sudo[85527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 Apr 24 01:11:01 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:01 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa Apr 24 01:11:01 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:02 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa" returned: 0 in 0.711s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:02 devstack sudo[85536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa Apr 24 01:11:02 devstack sudo[85536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:02 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8" returned: 0 in 0.777s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:02 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 is being set with open permissions: ugo+rw Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:02 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 Apr 24 01:11:02 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:02 devstack sudo[85536]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa" returned: 0 in 0.515s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Lock "cinder-quobyte-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa" released by "delete_volume" :: held 1.272s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Created reservations ['0b2db83f-aa9b-40ec-834c-df7f6d164c45', 'c91f6d99-e640-4421-8a98-ea4f5f454a89', '5c228087-7a19-4128-9cd6-9bc239b3858d', 'ae2ce76b-2acd-4486-a4d6-723cd6324d54'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:02 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:02 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:02 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8" returned: 0 in 0.571s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:02 devstack sudo[85544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.info Apr 24 01:11:02 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:03 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.478s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:03 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Deleted volume successfully. Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4d62c22f-2778-4923-986c-9bba4f2483dd tempest-VolumesTestJSON-1091769665 None] Lock "cinder-d3a21feb-d595-48bf-b5e9-70feaf6dfdfa-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:03 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.info" returned: 0 in 0.532s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:03 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.info is being set with open permissions: ugo+rw Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:03 devstack sudo[85551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.info Apr 24 01:11:03 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Acquiring lock "cinder-b4521523-5ad7-42f4-9bdf-433812ec0e2f-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Lock "cinder-b4521523-5ad7-42f4-9bdf-433812ec0e2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Acquiring lock "cinder-quobyte-b4521523-5ad7-42f4-9bdf-433812ec0e2f" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Lock "cinder-quobyte-b4521523-5ad7-42f4-9bdf-433812ec0e2f" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[684c130e-4149-4a23-abf0-86b60d11091c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:03 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f Apr 24 01:11:03 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:03 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.info" returned: 0 in 0.487s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.004s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.303s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:03 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b7d97e6e-a8de-4860-ba91-be38c4bee03e tempest-VolumesDeleteCascade-1029263106 None] Create snapshot completed successfully Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d96900a-b409-4df7-8b83-50552c5ae91d]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:03 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:11:03 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:04 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f" returned: 0 in 0.663s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:04 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f Apr 24 01:11:04 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:04 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 0 in 0.535s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:04 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:11:04 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:04 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b4521523-5ad7-42f4-9bdf-433812ec0e2f" returned: 0 in 0.638s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Lock "cinder-quobyte-b4521523-5ad7-42f4-9bdf-433812ec0e2f" released by "delete_volume" :: held 1.366s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Created reservations ['d56c7d03-0112-402f-b013-9d61247b5b01', '7c5d4ce6-b268-45ad-93e3-0a3f2a6a2889', 'c2567fb5-2b85-4c36-9051-ed225a3f47ea', 'cd19d8e7-839c-4113-822c-0d0c3b2d01d8'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:05 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:05 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:05 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 1 in 0.817s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 2G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 2G" returned: 0 in 0.100s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.499s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.047s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Creating offline snapshot 0dd33a93-05af-4486-af2c-874b28d13cab of volume e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeae04d-324e-4afb-ba0d-375a5db5222f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:05 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-bdc3b441-b012-45e1-9523-161e322a2bdb tempest-VolumesExtendTest-1400656938 None] Extend volume completed successfully. Apr 24 01:11:05 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 Apr 24 01:11:05 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:05 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.710s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:05 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:05 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Deleted volume successfully. Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Acquiring lock "cinder-ea6b0e03-a846-4796-a787-0a3bb9fd5a05-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Lock "cinder-ea6b0e03-a846-4796-a787-0a3bb9fd5a05-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d80d149-2a5c-4713-99cf-7b3715fee573 tempest-VolumesTestJSON-1091769665 None] Lock "cinder-b4521523-5ad7-42f4-9bdf-433812ec0e2f-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Acquiring lock "cinder-quobyte-ea6b0e03-a846-4796-a787-0a3bb9fd5a05" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Lock "cinder-quobyte-ea6b0e03-a846-4796-a787-0a3bb9fd5a05" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f56517-663b-4bb0-a39f-12c7950e2c21]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:06 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8" returned: 0 in 0.916s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:06 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab 1G Apr 24 01:11:06 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:06 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 Apr 24 01:11:06 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "cinder-b0585de0-e34b-4e58-9fb9-9b79099e8107-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Lock "cinder-b0585de0-e34b-4e58-9fb9-9b79099e8107-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "cinder-quobyte-b0585de0-e34b-4e58-9fb9-9b79099e8107" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Lock "cinder-quobyte-b0585de0-e34b-4e58-9fb9-9b79099e8107" acquired by "delete_volume" :: waited 0.034s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[39810cab-4fae-4b8d-a394-c627de82e04e]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:06 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:11:06 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:07 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05" returned: 0 in 1.257s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:07 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05 Apr 24 01:11:07 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:07 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab 1G" returned: 0 in 1.343s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:07 devstack sudo[85679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab Apr 24 01:11:07 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:07 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 0 in 1.118s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:08 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:11:08 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:08 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ea6b0e03-a846-4796-a787-0a3bb9fd5a05" returned: 0 in 0.584s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Lock "cinder-quobyte-ea6b0e03-a846-4796-a787-0a3bb9fd5a05" released by "delete_volume" :: held 1.919s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Created reservations ['3ee67923-59f0-4729-8a46-5374a82f6402', 'fdd03cb9-cb4e-4c2a-8f7a-23b5e53cb2f4', '43a60bfb-e4d6-42f0-9a9e-e7c7d8c76f8d', 'ba8757d5-1122-44b6-b3c0-4b843700fad3'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:08 devstack sudo[85689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:08 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:08 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab" returned: 0 in 0.879s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:08 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab is being set with open permissions: ugo+rw Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:08 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab Apr 24 01:11:08 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:08 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 1 in 0.755s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:11:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:08 devstack sudo[85696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107 Apr 24 01:11:08 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:09 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.744s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:09 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Deleted volume successfully. Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-474dd56a-1c45-4559-b789-135980d44ec5 tempest-VolumesTestJSON-1091769665 None] Lock "cinder-ea6b0e03-a846-4796-a787-0a3bb9fd5a05-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:09 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b0585de0-e34b-4e58-9fb9-9b79099e8107" returned: 0 in 0.878s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Lock "cinder-quobyte-b0585de0-e34b-4e58-9fb9-9b79099e8107" released by "delete_volume" :: held 2.870s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:09 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab" returned: 0 in 1.064s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.329s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Created reservations ['4ca3c1bb-70a0-41d1-81f0-75473239374c', '3349cdb4-aa3f-4742-a8b1-ebbe16f59036', '890ad789-bbd5-475d-8dd0-e1758bdf8604', 'f5354efa-e392-42ff-82bb-93dc0f5b2e7b'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:09 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e2786afc-47d4-4c30-9398-f9c4ec260468 tempest-VolumesDeleteCascade-1029263106 None] Create snapshot completed successfully Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:09 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:09 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:10 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Flow 'volume_create_manager' (5ddf23c6-4f51-451a-b0dc-3150cd06e6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55f53b1-0616-4823-a00d-7339072da22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55f53b1-0616-4823-a00d-7339072da22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1856830676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0b6580-672c-4107-8a72-d0cb9173488a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299357656f394368aeacc82fc5f52f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:11Z,use_quota=True,user_id='704e03dc305d49d38617c31628bfd32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a291f34-673c-4bee-8d49-d2268d1a12bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a291f34-673c-4bee-8d49-d2268d1a12bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c953fd57-6be6-4d8c-a37c-a3556df391ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c953fd57-6be6-4d8c-a37c-a3556df391ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0b6580-672c-4107-8a72-d0cb9173488a', 'volume_name': 'volume-3c0b6580-672c-4107-8a72-d0cb9173488a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c502a74-bef9-4d54-b5a4-68137cc6d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c502a74-bef9-4d54-b5a4-68137cc6d21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff8ce88-9600-4b57-8f3d-c1c6866bb57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:10 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Volume 3c0b6580-672c-4107-8a72-d0cb9173488a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0b6580-672c-4107-8a72-d0cb9173488a', 'volume_size': 1} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1856830676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0b6580-672c-4107-8a72-d0cb9173488a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299357656f394368aeacc82fc5f52f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:11Z,use_quota=True,user_id='704e03dc305d49d38617c31628bfd32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Creating volume 3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:10 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:10 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a 1073741824 Apr 24 01:11:10 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.097s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:10 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Deleted volume successfully. Apr 24 01:11:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4a9dfd3f-d7be-4e9e-9e1c-8d14dda90b41 tempest-VolumesExtendTest-1400656938 None] Lock "cinder-b0585de0-e34b-4e58-9fb9-9b79099e8107-delete_volume" released by "delete_volume" :: held 4.463s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Performing cascade delete. {{(pid=81925) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-0dd33a93-05af-4486-af2c-874b28d13cab-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-0dd33a93-05af-4486-af2c-874b28d13cab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-0dd33a93-05af-4486-af2c-874b28d13cab" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-0dd33a93-05af-4486-af2c-874b28d13cab" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Deleting offline snapshot 0dd33a93-05af-4486-af2c-874b28d13cab of volume e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] snapshot_file for this snap is: volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9aea4-9658-40eb-b7a8-4636a78feb89]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:11 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab Apr 24 01:11:11 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:11 devstack sudo[85713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:11 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:12 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a 1073741824" returned: 0 in 1.396s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:12 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab" returned: 0 in 1.060s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:12 devstack sudo[85719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a Apr 24 01:11:12 devstack sudo[85719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fb00fe-e9a7-44c5-95a1-63131a3f1418]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:12 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 Apr 24 01:11:12 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:12 devstack sudo[85719]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a" returned: 0 in 0.610s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff8ce88-9600-4b57-8f3d-c1c6866bb57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0b6580-672c-4107-8a72-d0cb9173488a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08743023-e9f6-4d2d-b201-f7dbfeabd601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:12 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Volume volume-3c0b6580-672c-4107-8a72-d0cb9173488a (3c0b6580-672c-4107-8a72-d0cb9173488a): created successfully Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08743023-e9f6-4d2d-b201-f7dbfeabd601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Flow 'volume_create_manager' (5ddf23c6-4f51-451a-b0dc-3150cd06e6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:12 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-11e7528c-fa7a-44d2-a458-cc5d01910d83 tempest-VolumesExtendTest-1400656938 None] Created volume successfully. Apr 24 01:11:13 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.244s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:13 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:13 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8" returned: 0 in 1.066s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:13 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab Apr 24 01:11:13 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:14 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Creating offline snapshot ea3190d1-8678-4127-a902-dd244a6d7b88 of volume 3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:11:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab" returned: 0 in 1.088s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:14 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[df125daa-aba1-4da6-b27d-88217aaa65db]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:14 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab Apr 24 01:11:14 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:14 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2c75371b-db9c-4dff-a6c4-85d80caa5232 tempest-GroupSnapshotsTest-672102948 None] Group tempest-GroupSnapshotsTest-Group-358375567: creating Apr 24 01:11:14 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a Apr 24 01:11:14 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:14 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2c75371b-db9c-4dff-a6c4-85d80caa5232 tempest-GroupSnapshotsTest-672102948 None] Group tempest-GroupSnapshotsTest-Group-358375567: created successfully Apr 24 01:11:14 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2c75371b-db9c-4dff-a6c4-85d80caa5232 tempest-GroupSnapshotsTest-672102948 None] Create group completed successfully. Apr 24 01:11:15 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a" returned: 0 in 0.718s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:15 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.0dd33a93-05af-4486-af2c-874b28d13cab" returned: 0 in 0.765s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:15 devstack sudo[85763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 1G Apr 24 01:11:15 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-0dd33a93-05af-4486-af2c-874b28d13cab" released by "_delete_snapshot" :: held 4.142s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" released by "delete_snapshot" :: held 4.182s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Created reservations ['007cfdec-d1d7-43a1-bbbd-986b120aff00', '7bf7d09e-e9e5-45ad-aa3e-318147920de9', 'c686c6a6-971d-4b41-ab15-9296562eac36', '6c255fdd-3fc5-4452-8395-b6e88ae258e1'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:15 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Delete snapshot completed successfully. Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-0dd33a93-05af-4486-af2c-874b28d13cab-delete_snapshot" released by "delete_snapshot" :: held 4.367s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-c39de7d7-24b2-4b57-8577-ef7a5161e6f8-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-c39de7d7-24b2-4b57-8577-ef7a5161e6f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-c39de7d7-24b2-4b57-8577-ef7a5161e6f8" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-c39de7d7-24b2-4b57-8577-ef7a5161e6f8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Deleting offline snapshot c39de7d7-24b2-4b57-8577-ef7a5161e6f8 of volume e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] snapshot_file for this snap is: volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0641b3-8ecd-4bc9-b101-f244dacbc4f3]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:15 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 Apr 24 01:11:15 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:16 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 1G" returned: 0 in 0.869s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0b6580-672c-4107-8a72-d0cb9173488a -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:16 devstack sudo[85779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0b6580-672c-4107-8a72-d0cb9173488a -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 Apr 24 01:11:16 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Flow 'volume_create_manager' (f49e822a-6e7f-4e52-8639-bf16f9760bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0326c5-c97f-4b49-a489-0cac2737403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0326c5-c97f-4b49-a489-0cac2737403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1304807817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d16c69e-9fae-4246-960b-8d08625f99b5,host='devstack@QuobyteHD#QuobyteHD',id=f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8438387c224e4cbd8d76ae007f3693b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:16Z,use_quota=True,user_id='d2c455f12f2240cba7fe180c9408dcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d19509-5a04-4c19-bf90-c1393e20910c),volume_type_id=32d19509-5a04-4c19-bf90-c1393e20910c)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a882d979-53d8-4c69-9905-3fbc0705912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a882d979-53d8-4c69-9905-3fbc0705912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6f601f-8dce-420c-825b-b9f2bb909914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:16 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6f601f-8dce-420c-825b-b9f2bb909914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7', 'volume_name': 'volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74adf5e1-40b9-4a5b-bf29-c4218c71db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74adf5e1-40b9-4a5b-bf29-c4218c71db20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5f78b2-0f93-4cfe-958f-d4dd3ff87949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:16 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Volume f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7', 'volume_size': 1} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8" returned: 0 in 0.962s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d8801d-02ba-4786-bc46-b7d04bdd4a98]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:16 devstack sudo[85784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 Apr 24 01:11:16 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:17 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0b6580-672c-4107-8a72-d0cb9173488a -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88" returned: 0 in 0.993s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:17 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 is being set with open permissions: ugo+rw Apr 24 01:11:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:17 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 Apr 24 01:11:17 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:17 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" returned: 0 in 0.583s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:17 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 Apr 24 01:11:17 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:17 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88" returned: 0 in 0.558s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:17 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.info Apr 24 01:11:17 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:17 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8" returned: 0 in 0.766s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:17 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8 Apr 24 01:11:17 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:18 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.info" returned: 0 in 0.687s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:18 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.info is being set with open permissions: ugo+rw Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:18 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.info Apr 24 01:11:18 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:18 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39.c39de7d7-24b2-4b57-8577-ef7a5161e6f8" returned: 0 in 0.519s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-c39de7d7-24b2-4b57-8577-ef7a5161e6f8" released by "_delete_snapshot" :: held 2.946s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" released by "delete_snapshot" :: held 2.982s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=90,cinder:UPDATE=105,cinder:DELETE=9,cinder:INSERT=29 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=108,cinder:SELECT=84,cinder:INSERT=31,cinder:DELETE=10 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Created reservations ['69a72342-ea41-44c8-91bc-8fe4630533a1', '05093b74-219f-47fd-8f92-939d38c77f32', 'c6c68c96-3c3f-4f57-a848-43a1b653bf39', 'fb6fda10-6638-4fb4-9579-98289ab26acb'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:18 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Delete snapshot completed successfully. Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-c39de7d7-24b2-4b57-8577-ef7a5161e6f8-delete_snapshot" released by "delete_snapshot" :: held 3.181s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Snapshots deleted, issuing volume delete {{(pid=81925) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[720ef3e8-ddca-4db6-adb4-595df372ab2e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:18 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 Apr 24 01:11:18 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:19 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.info" returned: 0 in 0.690s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.712s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.564s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d16c69e-9fae-4246-960b-8d08625f99b5,created_at=2026-04-23T23:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1304807817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d16c69e-9fae-4246-960b-8d08625f99b5,host='devstack@QuobyteHD#QuobyteHD',id=f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8438387c224e4cbd8d76ae007f3693b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:16Z,use_quota=True,user_id='d2c455f12f2240cba7fe180c9408dcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d19509-5a04-4c19-bf90-c1393e20910c),volume_type_id=32d19509-5a04-4c19-bf90-c1393e20910c)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Creating volume f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:19 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:19 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-3ce7beba-1f47-40dc-9098-2925c7814984 tempest-VolumesExtendTest-1400656938 None] Create snapshot completed successfully Apr 24 01:11:19 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 1073741824 Apr 24 01:11:19 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:19 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" returned: 0 in 0.738s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:19 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39 Apr 24 01:11:19 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a0bf6b7d-daa6-4753-94a6-e1e84c3151fb tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:20 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 1073741824" returned: 0 in 0.902s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:20 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 Apr 24 01:11:20 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:20 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" returned: 0 in 0.586s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39" released by "delete_volume" :: held 1.464s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Created reservations ['92f790b6-4421-4ff1-88d8-aea7e87ad392', '24f801d2-cccc-4031-af0a-2e29f0a5e6d5', '4ed31972-e16b-481f-836b-ac05d08c398e', 'c875eb62-d6ef-4d9d-a5d1-579e960e9569'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:20 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:20 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:20 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" returned: 0 in 0.524s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a0bf6b7d-daa6-4753-94a6-e1e84c3151fb tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.688s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5f78b2-0f93-4cfe-958f-d4dd3ff87949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce3abde-ffb2-43da-9670-0cbff9fe853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef1e32c-d5e9-4882-98ee-d67fa5ee3bab]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a0bf6b7d-daa6-4753-94a6-e1e84c3151fb tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:20 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Volume volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 (f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7): created successfully Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce3abde-ffb2-43da-9670-0cbff9fe853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Flow 'volume_create_manager' (f49e822a-6e7f-4e52-8639-bf16f9760bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:20 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d998ed11-fb9e-4042-8198-78ef28dbfd12 tempest-GroupSnapshotsTest-672102948 None] Created volume successfully. Apr 24 01:11:20 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a Apr 24 01:11:20 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:20 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.543s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:20 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Deleted volume successfully. Apr 24 01:11:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-43d1596a-735c-4de2-8b6e-0ab213a7d770 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-e2f1de31-ba2a-4fc2-8854-08e17a8a2d39-delete_volume" released by "delete_volume" :: held 9.889s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] GroupSnapshot 1d1eef49-173f-4a30-9fb6-6b5f32362ba6: creating. Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Group snapshot 1d1eef49-173f-4a30-9fb6-6b5f32362ba6: creating. {{(pid=81925) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:21 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a0bf6b7d-daa6-4753-94a6-e1e84c3151fb tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a" returned: 0 in 0.775s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a0bf6b7d-daa6-4753-94a6-e1e84c3151fb tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 2G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a0bf6b7d-daa6-4753-94a6-e1e84c3151fb tempest-VolumesExtendTest-1400656938 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 2G" returned: 0 in 0.172s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a0bf6b7d-daa6-4753-94a6-e1e84c3151fb tempest-VolumesExtendTest-1400656938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.988s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.461s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Creating offline snapshot 58101a46-1858-451d-b855-765f818158ea of volume f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b96e3dd-1e2d-448d-ba3f-f6bef041ae59]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Flow 'volume_create_manager' (5ecbd703-c392-4beb-89cd-48662035c525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240a5d6c-7912-4528-9b5a-97be0ce0ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240a5d6c-7912-4528-9b5a-97be0ce0ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-588134548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ef3ef0-4511-459d-85d3-f0991e84687b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bf746f9ee045c8b22c29a68627f98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:22Z,use_quota=True,user_id='f7b1d42166e0463497a95f6d2c38c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ec2e8-ab2d-4801-8ac2-6ae3ff9b892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:21 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 Apr 24 01:11:21 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ec2e8-ab2d-4801-8ac2-6ae3ff9b892d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fd130b-7583-4618-99e7-67858a33a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fd130b-7583-4618-99e7-67858a33a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ef3ef0-4511-459d-85d3-f0991e84687b', 'volume_name': 'volume-56ef3ef0-4511-459d-85d3-f0991e84687b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8026b9b-4db1-425f-95d0-a386fb272825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8026b9b-4db1-425f-95d0-a386fb272825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1668d5d9-3572-421c-a8d3-787e33764494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:21 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Volume 56ef3ef0-4511-459d-85d3-f0991e84687b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ef3ef0-4511-459d-85d3-f0991e84687b', 'volume_size': 1} Apr 24 01:11:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a0bf6b7d-daa6-4753-94a6-e1e84c3151fb tempest-VolumesExtendTest-1400656938 None] Extend volume completed successfully. Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Acquiring lock "cinder-ea3190d1-8678-4127-a902-dd244a6d7b88-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Lock "cinder-ea3190d1-8678-4127-a902-dd244a6d7b88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Acquiring lock "cinder-quobyte-3c0b6580-672c-4107-8a72-d0cb9173488a" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Lock "cinder-quobyte-3c0b6580-672c-4107-8a72-d0cb9173488a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Acquiring lock "cinder-quobyte-ea3190d1-8678-4127-a902-dd244a6d7b88" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:22 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" returned: 0 in 0.658s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Lock "cinder-quobyte-ea3190d1-8678-4127-a902-dd244a6d7b88" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Deleting offline snapshot ea3190d1-8678-4127-a902-dd244a6d7b88 of volume 3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:11:22 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea 1G Apr 24 01:11:22 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] snapshot_file for this snap is: volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a165e6-edcf-439b-920c-b52e8ae4f1b5]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:22 devstack sudo[85881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 Apr 24 01:11:22 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:22 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88" returned: 0 in 0.564s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c0b6580-672c-4107-8a72-d0cb9173488a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e21b67-70fb-4819-9cf3-8387314dc5a3]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:22 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea 1G" returned: 0 in 0.652s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:23 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea Apr 24 01:11:23 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:23 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a Apr 24 01:11:23 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:23 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:23 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea" returned: 0 in 0.530s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:23 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:11:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a" returned: 0 in 0.548s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:23 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea Apr 24 01:11:23 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:23 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 Apr 24 01:11:23 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:24 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea" returned: 0 in 0.500s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:24 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.info Apr 24 01:11:24 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:24 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88" returned: 0 in 0.625s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:24 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88 Apr 24 01:11:24 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:24 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a.ea3190d1-8678-4127-a902-dd244a6d7b88" returned: 0 in 0.450s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Lock "cinder-quobyte-ea3190d1-8678-4127-a902-dd244a6d7b88" released by "_delete_snapshot" :: held 2.301s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Lock "cinder-quobyte-3c0b6580-672c-4107-8a72-d0cb9173488a" released by "delete_snapshot" :: held 2.335s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:24 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.info" returned: 0 in 0.585s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:24 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:24 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.info Apr 24 01:11:24 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Created reservations ['887cfe9c-3179-45d9-a410-77d4737976cd', 'b2c5a328-31c7-4115-992b-a5eca489949e', 'cee56ab0-091d-4d12-a120-ca4d6a72a15d', '65a27fe6-3e60-4dd9-a86d-4c46c94c5cbf'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:24 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Delete snapshot completed successfully. Apr 24 01:11:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-dbd4f549-c2de-4d7f-85cb-9fd78c1b584b tempest-VolumesExtendTest-1400656938 None] Lock "cinder-ea3190d1-8678-4127-a902-dd244a6d7b88-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:25 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.info" returned: 0 in 0.527s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.581s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.425s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-588134548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ef3ef0-4511-459d-85d3-f0991e84687b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bf746f9ee045c8b22c29a68627f98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:22Z,use_quota=True,user_id='f7b1d42166e0463497a95f6d2c38c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Creating volume 56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:25 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:25 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b 1073741824 Apr 24 01:11:25 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:25 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f9a4a1d1-9b2d-4df8-82e9-ea498e00008d tempest-GroupSnapshotsTest-672102948 None] group_snapshot 1d1eef49-173f-4a30-9fb6-6b5f32362ba6: created successfully Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "cinder-3c0b6580-672c-4107-8a72-d0cb9173488a-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Lock "cinder-3c0b6580-672c-4107-8a72-d0cb9173488a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "cinder-quobyte-3c0b6580-672c-4107-8a72-d0cb9173488a" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Lock "cinder-quobyte-3c0b6580-672c-4107-8a72-d0cb9173488a" acquired by "delete_volume" :: waited 0.032s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a34e201-4179-4db4-8f19-57681eb4edc6]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:25 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a Apr 24 01:11:25 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:26 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b 1073741824" returned: 0 in 0.812s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:26 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b Apr 24 01:11:26 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:26 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a" returned: 0 in 0.709s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:26 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a Apr 24 01:11:26 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:27 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b" returned: 0 in 0.965s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.290s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-58101a46-1858-451d-b855-765f818158ea-bb84a28b-cb95-46be-8c44-26c3cc111865" by "_create_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-58101a46-1858-451d-b855-765f818158ea-bb84a28b-cb95-46be-8c44-26c3cc111865" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Creating volume bb84a28b-cb95-46be-8c44-26c3cc111865 from snapshot 58101a46-1858-451d-b855-765f818158ea {{(pid=81925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-bb84a28b-cb95-46be-8c44-26c3cc111865" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1668d5d9-3572-421c-a8d3-787e33764494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ef3ef0-4511-459d-85d3-f0991e84687b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3964ee-99d1-49e4-b45b-868ffec41770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:27 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Volume volume-56ef3ef0-4511-459d-85d3-f0991e84687b (56ef3ef0-4511-459d-85d3-f0991e84687b): created successfully Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3964ee-99d1-49e4-b45b-868ffec41770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Flow 'volume_create_manager' (5ecbd703-c392-4beb-89cd-48662035c525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-bb84a28b-cb95-46be-8c44-26c3cc111865" acquired by "_copy_volume_from_snapshot" :: waited 0.094s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] snapshot: 58101a46-1858-451d-b855-765f818158ea, volume: bb84a28b-cb95-46be-8c44-26c3cc111865, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:11:27 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-6550aaa1-85dc-490d-b8cd-85dff667d1cd tempest-VolumesDeleteCascade-1029263106 None] Created volume successfully. Apr 24 01:11:27 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c0b6580-672c-4107-8a72-d0cb9173488a" returned: 0 in 0.817s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Lock "cinder-quobyte-3c0b6580-672c-4107-8a72-d0cb9173488a" released by "delete_volume" :: held 1.630s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7056bd4-5ebd-41d8-b200-87c376393f0f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Created reservations ['3843ee16-7f73-4d05-a680-308c4136928c', 'c47133e5-2ce5-498d-a6b8-841092f4f500', '68e1b4de-65f6-470a-843a-2ea81dab41aa', 'cb7011dd-bf77-46b1-b2d5-0423320b2bce'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:27 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea Apr 24 01:11:27 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:27 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:27 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Flow 'volume_create_manager' (3bb14595-ea0b-40b5-b2a9-c3fe21a83751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ef198-4ac5-4f99-babd-140c0ef620df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ef198-4ac5-4f99-babd-140c0ef620df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003767d3c8451a88ea140b94e39ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:28Z,use_quota=True,user_id='0df28b7e90c9416db3ce908c473dd1e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bf2b0b-112e-417f-b750-a6ecbf10c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bf2b0b-112e-417f-b750-a6ecbf10c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:27 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3a812b-ca92-4e24-bb90-aa7838d6aad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.image.glance [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Creating Keystone auth plugin from conf {{(pid=81925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.623s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Deleted volume successfully. Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4529a280-9855-4171-9beb-8a584aa09311 tempest-VolumesExtendTest-1400656938 None] Lock "cinder-3c0b6580-672c-4107-8a72-d0cb9173488a-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:28 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea" returned: 0 in 1.069s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d639a9b-3f19-48de-a078-c97b23bcc895]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:28 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 Apr 24 01:11:28 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3a812b-ca92-4e24-bb90-aa7838d6aad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1', 'volume_name': 'volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7a4e4f-64c4-46cb-87bf-1009f9cd48bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7a4e4f-64c4-46cb-87bf-1009f9cd48bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506b5694-b6f6-43da-b6cb-3949d0e51291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:28 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Volume 9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 01:11:28 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Trying to clone 9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 from image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]). {{(pid=81925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 01:11:29 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 01:11:29 devstack cinder-volume[81925]: INFO cinder.image.image_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Image download 20.69 MB at 20.69 MB/s Apr 24 01:11:29 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" returned: 0 in 0.831s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:29 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:11:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:29 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d87b218-9af2-4ada-be0d-daf74d3dd337]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:29 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 Apr 24 01:11:29 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:29 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD Apr 24 01:11:29 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:29 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:29 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Temporary image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 is fetched for user 0df28b7e90c9416db3ce908c473dd1e3. {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 01:11:30 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8c2221-daea-465c-a917-b21b0c926acb]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:30 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD Apr 24 01:11:30 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:31 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD" returned: 0 in 1.381s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Flow 'volume_create_manager' (8dfcdc33-7dd7-4fb7-bf38-4d10d66ba8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63d66a0-b9ce-4740-b0b4-6e98c8172693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63d66a0-b9ce-4740-b0b4-6e98c8172693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1241662192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa87b97-1bda-4c4f-9260-2645ee8a8bcf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af94d8710554ca7af75d0459a3fb6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:34Z,use_quota=True,user_id='b73e2e33d01c4df6b64f9a029b48c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721fce87-9251-4a1a-abcc-b6f27269ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721fce87-9251-4a1a-abcc-b6f27269ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbca76e-27b6-4b01-9c84-3fbbf447bceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbca76e-27b6-4b01-9c84-3fbbf447bceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa87b97-1bda-4c4f-9260-2645ee8a8bcf', 'volume_name': 'volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a365f5d6-025e-4542-b108-5d992cee8539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a365f5d6-025e-4542-b108-5d992cee8539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9cbd38-0355-4920-bba2-0d41a9f55dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:33 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Volume 8aa87b97-1bda-4c4f-9260-2645ee8a8bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf', 'volume_size': 1} Apr 24 01:11:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:35 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865" returned: 0 in 6.329s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:35 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e0408d-8308-4e31-9cd9-d11c7a777c2f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:35 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 Apr 24 01:11:35 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:36 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" returned: 0 in 0.666s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:11:36 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Converted 1024.00 MB image at 161.76 MB/s Apr 24 01:11:36 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:36 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 Apr 24 01:11:36 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:36 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865" returned: 0 in 0.444s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-bb84a28b-cb95-46be-8c44-26c3cc111865" released by "_copy_volume_from_snapshot" :: held 9.537s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-58101a46-1858-451d-b855-765f818158ea-bb84a28b-cb95-46be-8c44-26c3cc111865" released by "_create_volume_from_snapshot" :: held 9.656s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.690s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.182s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Creating offline snapshot 44178f13-4c2d-4d04-acc5-c7b3f9435358 of volume 56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb3846-81a7-4d91-b7cc-9e6e6720d049]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:36 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a871fb93-303e-4509-bfc7-48c8e6fd0592 tempest-GroupSnapshotsTest-672102948 None] Create group from source-snapshot-1d1eef49-173f-4a30-9fb6-6b5f32362ba6 completed successfully. Apr 24 01:11:36 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b Apr 24 01:11:36 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:37 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b" returned: 0 in 0.585s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:37 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 1G Apr 24 01:11:37 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:38 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 1G" returned: 0 in 0.661s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ef3ef0-4511-459d-85d3-f0991e84687b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:38 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ef3ef0-4511-459d-85d3-f0991e84687b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 Apr 24 01:11:38 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-bb84a28b-cb95-46be-8c44-26c3cc111865" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-bb84a28b-cb95-46be-8c44-26c3cc111865" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1571076-8f3f-48f4-9f6e-c2931fca486b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:38 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 Apr 24 01:11:38 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:38 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ef3ef0-4511-459d-85d3-f0991e84687b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358" returned: 0 in 0.564s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:38 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 is being set with open permissions: ugo+rw Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:38 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 Apr 24 01:11:38 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:38 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865" returned: 0 in 0.598s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:38 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865 Apr 24 01:11:38 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:39 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358" returned: 0 in 0.473s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:39 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.info Apr 24 01:11:39 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:39 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-bb84a28b-cb95-46be-8c44-26c3cc111865" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-bb84a28b-cb95-46be-8c44-26c3cc111865" released by "delete_volume" :: held 1.167s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Created reservations ['aa2dde26-ac56-4bf4-8947-913e1c6d3b1e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:39 devstack cinder-volume[81925]: WARNING cinder.quota [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1250491976 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1250491976, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:11:39 devstack cinder-volume[81925]: WARNING cinder.quota [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1250491976 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1250491976, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Created reservations ['2305e220-0012-417b-b6df-fc6507c9b888', 'e3a13bfc-25f7-4cf4-8561-06358ea6142f', '1d0e571a-d096-41bb-9e5c-4bbdfaff2187', '49709690-ee3b-491d-b3d9-463a5a8c700c'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:39 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.info" returned: 0 in 0.553s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:39 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.info is being set with open permissions: ugo+rw Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:39 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.info Apr 24 01:11:39 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:39 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:39 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:40 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.info" returned: 0 in 0.455s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.424s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.760s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003767d3c8451a88ea140b94e39ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:28Z,use_quota=True,user_id='0df28b7e90c9416db3ce908c473dd1e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Creating volume 9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:40 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:40 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 1073741824 Apr 24 01:11:40 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-56451ae1-ece3-4b6c-bb04-6b8086618498 tempest-VolumesDeleteCascade-1029263106 None] Create snapshot completed successfully Apr 24 01:11:40 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.468s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-58e99eff-970f-4786-8d79-8df1ca5f2e9c tempest-GroupSnapshotsTest-672102948 None] Delete group completed successfully. Apr 24 01:11:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] group_snapshot 1d1eef49-173f-4a30-9fb6-6b5f32362ba6: deleting Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] group_snapshot 1d1eef49-173f-4a30-9fb6-6b5f32362ba6: deleting {{(pid=81925) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-58101a46-1858-451d-b855-765f818158ea" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-58101a46-1858-451d-b855-765f818158ea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Deleting offline snapshot 58101a46-1858-451d-b855-765f818158ea of volume f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] snapshot_file for this snap is: volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc660f-bfe2-4bd6-8f4e-9b585f64213d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:40 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea Apr 24 01:11:40 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:40 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 1073741824" returned: 0 in 0.673s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:40 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:11:40 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:41 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea" returned: 0 in 0.585s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c09253-b5cc-4746-be8a-d1949b0b103c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:41 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 0 in 0.473s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.560s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1241662192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa87b97-1bda-4c4f-9260-2645ee8a8bcf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af94d8710554ca7af75d0459a3fb6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:34Z,use_quota=True,user_id='b73e2e33d01c4df6b64f9a029b48c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Creating volume 8aa87b97-1bda-4c4f-9260-2645ee8a8bcf {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:41 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:41 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf 1073741824 Apr 24 01:11:41 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:41 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 Apr 24 01:11:41 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Attempting download of a7c3cef6-73f5-4af2-9de8-0bc5792d6063 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}])) to volume 9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1. {{(pid=81925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52640e9-aed6-4ee5-9027-33610c200f72]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_6604gr9r {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:41 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_6604gr9r Apr 24 01:11:41 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Flow 'volume_create_manager' (b0d71e8b-464e-46b6-b0a4-a99654aa21a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f33ef78-c83a-4000-9706-3f7ab45e0123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f33ef78-c83a-4000-9706-3f7ab45e0123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1762147962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba0d137-e528-4cc6-90d2-6bc87eb0cff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bf746f9ee045c8b22c29a68627f98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44178f13-4c2d-4d04-acc5-c7b3f9435358,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:42Z,use_quota=True,user_id='f7b1d42166e0463497a95f6d2c38c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b7530e-2770-425a-9d7f-59dca9b6cc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b7530e-2770-425a-9d7f-59dca9b6cc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2401594e-1003-473d-82f9-be67b976a24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2401594e-1003-473d-82f9-be67b976a24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ba0d137-e528-4cc6-90d2-6bc87eb0cff5', 'volume_name': 'volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5', 'volume_size': 1, 'snapshot_id': '44178f13-4c2d-4d04-acc5-c7b3f9435358'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4feacd-fd41-4088-bc10-d5bca5e6829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4feacd-fd41-4088-bc10-d5bca5e6829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e93568-ac18-4150-8273-4b00cfbf0136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:41 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Volume 2ba0d137-e528-4cc6-90d2-6bc87eb0cff5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5', 'volume_size': 1, 'snapshot_id': '44178f13-4c2d-4d04-acc5-c7b3f9435358'} Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:41 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" returned: 0 in 0.672s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:42 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea Apr 24 01:11:42 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:42 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_6604gr9r" returned: 0 in 0.640s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_6604gr9r {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:42 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf 1073741824" returned: 0 in 0.806s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:42 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_6604gr9r Apr 24 01:11:42 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:42 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf Apr 24 01:11:42 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:42 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_6604gr9r" returned: 1 in 0.562s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_6604gr9r' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ef4e6-35e3-4c7d-963e-90e21aacce64]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:42 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea" returned: 0 in 0.736s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:42 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea Apr 24 01:11:42 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:42 devstack sudo[86062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD Apr 24 01:11:42 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:42 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf" returned: 0 in 0.556s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.972s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-44178f13-4c2d-4d04-acc5-c7b3f9435358-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" by "_create_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9cbd38-0355-4920-bba2-0d41a9f55dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7001ef35-7373-420b-b1b7-38f77610284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-44178f13-4c2d-4d04-acc5-c7b3f9435358-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Creating volume 2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 from snapshot 44178f13-4c2d-4d04-acc5-c7b3f9435358 {{(pid=81925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] snapshot: 44178f13-4c2d-4d04-acc5-c7b3f9435358, volume: 2ba0d137-e528-4cc6-90d2-6bc87eb0cff5, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:11:42 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Volume volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf (8aa87b97-1bda-4c4f-9260-2645ee8a8bcf): created successfully Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7001ef35-7373-420b-b1b7-38f77610284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Flow 'volume_create_manager' (8dfcdc33-7dd7-4fb7-bf38-4d10d66ba8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b9e16730-1351-47d5-9c55-2d3aac8b2e27 tempest-VolumesListTestJSON-1836123599 None] Created volume successfully. Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d080fff-50cf-4a37-8773-6f483ab82d5f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:42 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 Apr 24 01:11:42 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:43 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] a7c3cef6-73f5-4af2-9de8-0bc5792d6063 was qcow2, converting to raw {{(pid=81925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:43 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7.58101a46-1858-451d-b855-765f818158ea" returned: 0 in 0.580s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:43 devstack sudo[86072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:11:43 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-58101a46-1858-451d-b855-765f818158ea" released by "_delete_snapshot" :: held 2.685s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" released by "delete_snapshot" :: held 2.714s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:43 devstack cinder-volume[81925]: WARNING cinder.quota [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1250491976 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1250491976, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] Created reservations ['6b36a5f2-c144-44fa-8f7a-4362a728d4a1', 'c78045c9-7cee-4e7b-88e6-199478079c51', '0470ca37-6909-4730-94cd-f3288bedc154', '30e8530e-a9e5-45be-b1a9-b4f69dc5d0bb'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:43 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358" returned: 0 in 0.705s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56ef3ef0-4511-459d-85d3-f0991e84687b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79045e-bf90-41cd-b7a1-492d62eac58d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:43 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d18acdc5-e83e-4de0-8c9b-91676f0ec696 tempest-GroupSnapshotsTest-672102948 None] group_snapshot 1d1eef49-173f-4a30-9fb6-6b5f32362ba6: deleted successfully Apr 24 01:11:43 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b Apr 24 01:11:43 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Flow 'volume_create_manager' (c6263593-1c14-461b-96c8-035b3085f156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b9931f-3c3b-4e53-8263-b757c691dc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b9931f-3c3b-4e53-8263-b757c691dc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1407893940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906f4ffe-2497-412f-b01e-0317050c0fac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af94d8710554ca7af75d0459a3fb6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:44Z,use_quota=True,user_id='b73e2e33d01c4df6b64f9a029b48c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5453b6e9-27eb-48ce-9a31-24d3c482366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5453b6e9-27eb-48ce-9a31-24d3c482366c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3194a333-bb95-43ed-a91e-c0226c75801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3194a333-bb95-43ed-a91e-c0226c75801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906f4ffe-2497-412f-b01e-0317050c0fac', 'volume_name': 'volume-906f4ffe-2497-412f-b01e-0317050c0fac', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba901479-f880-4d97-81d4-084076646c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba901479-f880-4d97-81d4-084076646c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1701879-4546-4b2e-b182-8b26fa6a0aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:43 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Volume 906f4ffe-2497-412f-b01e-0317050c0fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906f4ffe-2497-412f-b01e-0317050c0fac', 'volume_size': 1} Apr 24 01:11:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[00382671-24e3-4b13-9dd3-6fe0287033ef]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:44 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b" returned: 0 in 0.683s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:44 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 Apr 24 01:11:44 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:44 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 Apr 24 01:11:44 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:44 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" returned: 0 in 0.654s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:44 devstack sudo[86097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7 Apr 24 01:11:44 devstack sudo[86097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:45 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 0 in 1.833s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:45 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_2uurj08ydevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:11:45 devstack cinder-volume[81925]: INFO cinder.image.image_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Converted 112.00 MB image at 61.02 MB/s Apr 24 01:11:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:45 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 1G Apr 24 01:11:45 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:46 devstack sudo[86097]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" returned: 0 in 1.216s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-f6c5e6af-ec63-47df-b7fa-f0abb8b40ee7" released by "delete_volume" :: held 2.001s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:46 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Created reservations ['bc440086-baee-4431-8456-009d895e6e7e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 1G" returned: 0 in 1.258s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb801b3-4a7b-4cef-97b7-9bb2c1f5dec0]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:46 devstack cinder-volume[81925]: WARNING cinder.db.sqlalchemy.api [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1250491976'] Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Created reservations ['cbc44164-fb36-4212-9d4c-53dd417addd8', '5b1cb15d-0896-4876-92f7-20d8c5b10b9b', 'ac4e1ba5-1900-47f5-901e-04a203d5c574', 'fabdadd4-00a8-4c54-b221-ed685b4765cb'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:46 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:11:46 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:46 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:46 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:48 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 0 in 1.578s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:48 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.315s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:48 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1b3e80a8-e9c6-41b2-9d3b-62937336e35d tempest-GroupSnapshotsTest-672102948 None] Delete group completed successfully. Apr 24 01:11:48 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:11:48 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-764e10be-0332-4a20-b89e-d99d07c6f8ea tempest-GroupSnapshotsTest-672102948 None] Group tempest-GroupSnapshotsTest-Group-2002638298: creating Apr 24 01:11:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-764e10be-0332-4a20-b89e-d99d07c6f8ea tempest-GroupSnapshotsTest-672102948 None] Group tempest-GroupSnapshotsTest-Group-2002638298: created successfully Apr 24 01:11:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-764e10be-0332-4a20-b89e-d99d07c6f8ea tempest-GroupSnapshotsTest-672102948 None] Create group completed successfully. Apr 24 01:11:49 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 1 in 1.825s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:11:49 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Downloaded image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}])) to volume 9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 successfully. {{(pid=81925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 01:11:49 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Temporary image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 for user 0df28b7e90c9416db3ce908c473dd1e3 is deleted. {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 01:11:49 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Marking volume 9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 as bootable. {{(pid=81925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 01:11:49 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Copying metadata from image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 to 9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1. {{(pid=81925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 01:11:49 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Creating volume glance metadata for volume 9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 backed by image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506b5694-b6f6-43da-b6cb-3949d0e51291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28f88ad-f7f4-4c83-aeb1-1ae11345fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:50 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Volume volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 (9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1): created successfully Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28f88ad-f7f4-4c83-aeb1-1ae11345fe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Flow 'volume_create_manager' (3bb14595-ea0b-40b5-b2a9-c3fe21a83751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:50 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-526afe86-c1d4-4843-aa94-c3d204817cf7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Created volume successfully. Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Flow 'volume_create_manager' (2bb7f3fb-98ba-418f-9ab4-a9dc48f87779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5495f2-0717-495c-8f65-028414b11fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5495f2-0717-495c-8f65-028414b11fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91237903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d81dbdf0-f6d8-446e-b6c9-8d324abf7b74,host='devstack@QuobyteHD#QuobyteHD',id=b36448f1-33f7-402d-be8c-7e3826317e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8438387c224e4cbd8d76ae007f3693b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:51Z,use_quota=True,user_id='d2c455f12f2240cba7fe180c9408dcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6f5937f-34be-426e-811f-8f2f47f56853),volume_type_id=d6f5937f-34be-426e-811f-8f2f47f56853)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db97598e-0396-4f59-8d23-41a8874303e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:50 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db97598e-0396-4f59-8d23-41a8874303e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcd805e-407a-4600-b99c-3bf4a5068561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcd805e-407a-4600-b99c-3bf4a5068561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36448f1-33f7-402d-be8c-7e3826317e9c', 'volume_name': 'volume-b36448f1-33f7-402d-be8c-7e3826317e9c', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c499a491-ddb2-4903-bfe4-c74ce36b84a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c499a491-ddb2-4903-bfe4-c74ce36b84a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c39ff4-aef2-4298-a801-fee21e3c5dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:50 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Volume b36448f1-33f7-402d-be8c-7e3826317e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36448f1-33f7-402d-be8c-7e3826317e9c', 'volume_size': 1} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" returned: 0 in 6.389s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf5e61c-a45d-476b-8704-4a877ff31980]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:50 devstack sudo[86140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b Apr 24 01:11:50 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:51 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b" returned: 0 in 0.700s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:11:51 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Converted 1024.00 MB image at 160.25 MB/s Apr 24 01:11:51 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 is being set with open permissions: ugo+rw Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:51 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 Apr 24 01:11:51 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:51 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" returned: 0 in 0.472s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" released by "_copy_volume_from_snapshot" :: held 9.054s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-44178f13-4c2d-4d04-acc5-c7b3f9435358-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" released by "_create_volume_from_snapshot" :: held 9.085s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.117s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.970s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1407893940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906f4ffe-2497-412f-b01e-0317050c0fac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af94d8710554ca7af75d0459a3fb6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:44Z,use_quota=True,user_id='b73e2e33d01c4df6b64f9a029b48c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Creating volume 906f4ffe-2497-412f-b01e-0317050c0fac {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:51 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:51 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac 1073741824 Apr 24 01:11:51 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e93568-ac18-4150-8273-4b00cfbf0136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5', 'volume_size': 1, 'snapshot_id': '44178f13-4c2d-4d04-acc5-c7b3f9435358'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c64ef90-efe0-4389-bafc-f2dbc74d63e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:51 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Volume volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 (2ba0d137-e528-4cc6-90d2-6bc87eb0cff5): created successfully Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c64ef90-efe0-4389-bafc-f2dbc74d63e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Flow 'volume_create_manager' (b0d71e8b-464e-46b6-b0a4-a99654aa21a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:52 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9e309281-790a-48d2-bc1f-666b3212d6c9 tempest-VolumesDeleteCascade-1029263106 None] Created volume successfully. Apr 24 01:11:52 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac 1073741824" returned: 0 in 0.636s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:52 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac Apr 24 01:11:52 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-56ef3ef0-4511-459d-85d3-f0991e84687b-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-56ef3ef0-4511-459d-85d3-f0991e84687b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Performing cascade delete. {{(pid=81925) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-44178f13-4c2d-4d04-acc5-c7b3f9435358-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-44178f13-4c2d-4d04-acc5-c7b3f9435358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-56ef3ef0-4511-459d-85d3-f0991e84687b" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-56ef3ef0-4511-459d-85d3-f0991e84687b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-44178f13-4c2d-4d04-acc5-c7b3f9435358" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-44178f13-4c2d-4d04-acc5-c7b3f9435358" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Deleting offline snapshot 44178f13-4c2d-4d04-acc5-c7b3f9435358 of volume 56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] snapshot_file for this snap is: volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bfaae1-e5fd-4c2c-b182-788d1cfce3ae]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:53 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 Apr 24 01:11:53 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:53 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac" returned: 0 in 0.551s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d81dbdf0-f6d8-446e-b6c9-8d324abf7b74,created_at=2026-04-23T23:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91237903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d81dbdf0-f6d8-446e-b6c9-8d324abf7b74,host='devstack@QuobyteHD#QuobyteHD',id=b36448f1-33f7-402d-be8c-7e3826317e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8438387c224e4cbd8d76ae007f3693b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:51Z,use_quota=True,user_id='d2c455f12f2240cba7fe180c9408dcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6f5937f-34be-426e-811f-8f2f47f56853),volume_type_id=d6f5937f-34be-426e-811f-8f2f47f56853)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Creating volume b36448f1-33f7-402d-be8c-7e3826317e9c {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:53 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1701879-4546-4b2e-b182-8b26fa6a0aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906f4ffe-2497-412f-b01e-0317050c0fac', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:53 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c 1073741824 Apr 24 01:11:53 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b651617-3df7-4d6e-86d0-ea6e9d0972a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:53 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Volume volume-906f4ffe-2497-412f-b01e-0317050c0fac (906f4ffe-2497-412f-b01e-0317050c0fac): created successfully Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b651617-3df7-4d6e-86d0-ea6e9d0972a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Flow 'volume_create_manager' (c6263593-1c14-461b-96c8-035b3085f156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:53 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-69aa615e-1dde-4474-8daa-db68a1504bf3 tempest-VolumesListTestJSON-1836123599 None] Created volume successfully. Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:53 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358" returned: 0 in 0.651s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56ef3ef0-4511-459d-85d3-f0991e84687b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b60735-75c0-4c24-900d-d22ce5947803]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:53 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b Apr 24 01:11:53 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:53 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c 1073741824" returned: 0 in 0.739s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:53 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c Apr 24 01:11:53 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Flow 'volume_create_manager' (c87ca0be-7e50-4cb6-9898-04a031e0240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640c27d8-db28-4d1f-8ce0-f173bc74ece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640c27d8-db28-4d1f-8ce0-f173bc74ece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-31759768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b72302-3231-4d79-88db-4f0358e14975,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af94d8710554ca7af75d0459a3fb6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:54Z,use_quota=True,user_id='b73e2e33d01c4df6b64f9a029b48c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093ae41d-113c-42b2-b228-2515dfd0064f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093ae41d-113c-42b2-b228-2515dfd0064f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588b727b-384b-4da7-907a-d31cec7c4405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588b727b-384b-4da7-907a-d31cec7c4405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b72302-3231-4d79-88db-4f0358e14975', 'volume_name': 'volume-77b72302-3231-4d79-88db-4f0358e14975', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da68eb5d-5370-4264-ac88-156810f6f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:54 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da68eb5d-5370-4264-ac88-156810f6f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c6cad8-fa7a-472d-b230-5e5e0feb1ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:54 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Volume 77b72302-3231-4d79-88db-4f0358e14975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b72302-3231-4d79-88db-4f0358e14975', 'volume_size': 1} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b" returned: 0 in 0.711s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:54 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 Apr 24 01:11:54 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:54 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c" returned: 0 in 0.541s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.139s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c39ff4-aef2-4298-a801-fee21e3c5dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36448f1-33f7-402d-be8c-7e3826317e9c', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2a79bc-a2a3-43de-9103-fe81281cb879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd61cadc-04de-4651-afb5-0bf8ec4f28c1]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:54 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Volume volume-b36448f1-33f7-402d-be8c-7e3826317e9c (b36448f1-33f7-402d-be8c-7e3826317e9c): created successfully Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2a79bc-a2a3-43de-9103-fe81281cb879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Flow 'volume_create_manager' (2bb7f3fb-98ba-418f-9ab4-a9dc48f87779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:54 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-bfb7ebee-40f8-4c25-b176-bd987cd90322 tempest-GroupSnapshotsTest-672102948 None] Created volume successfully. Apr 24 01:11:54 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:11:54 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:55 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358" returned: 0 in 0.646s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:55 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358 Apr 24 01:11:55 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:55 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 0 in 0.580s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:55 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:11:55 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Flow 'volume_create_manager' (d7748053-0122-47d3-8f48-5933c054e4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541d562c-3317-4bda-8bc5-e6cee48d1e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541d562c-3317-4bda-8bc5-e6cee48d1e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843762379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d81dbdf0-f6d8-446e-b6c9-8d324abf7b74,host='devstack@QuobyteHD#QuobyteHD',id=5cff309f-d3ea-4658-b749-d134803b3614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8438387c224e4cbd8d76ae007f3693b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:55Z,use_quota=True,user_id='d2c455f12f2240cba7fe180c9408dcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6f5937f-34be-426e-811f-8f2f47f56853),volume_type_id=d6f5937f-34be-426e-811f-8f2f47f56853)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ea7e53-3f37-4b0a-a482-8e346063094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ea7e53-3f37-4b0a-a482-8e346063094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5277e4b-7c34-4b5b-8ae7-c186adf2c9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5277e4b-7c34-4b5b-8ae7-c186adf2c9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cff309f-d3ea-4658-b749-d134803b3614', 'volume_name': 'volume-5cff309f-d3ea-4658-b749-d134803b3614', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366c3fe1-2df2-443d-8e14-eb9813365d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366c3fe1-2df2-443d-8e14-eb9813365d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db7b35d-453e-4961-a812-813109c3a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:55 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Volume 5cff309f-d3ea-4658-b749-d134803b3614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cff309f-d3ea-4658-b749-d134803b3614', 'volume_size': 1} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:55 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b.44178f13-4c2d-4d04-acc5-c7b3f9435358" returned: 0 in 0.568s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-44178f13-4c2d-4d04-acc5-c7b3f9435358" released by "_delete_snapshot" :: held 2.679s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-56ef3ef0-4511-459d-85d3-f0991e84687b" released by "delete_snapshot" :: held 2.701s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Created reservations ['ff7965a3-c3e7-497e-90cd-58064e28d212', 'e619de41-2bef-469a-acf6-b63ca23cb7e8', '528dc64f-68c3-45eb-bc06-1354fd65cc7d', 'a108c8fe-3916-4bc5-ad75-f108a146c8c5'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:55 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 1 in 0.659s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.278s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.353s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-31759768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b72302-3231-4d79-88db-4f0358e14975,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af94d8710554ca7af75d0459a3fb6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:54Z,use_quota=True,user_id='b73e2e33d01c4df6b64f9a029b48c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Creating volume 77b72302-3231-4d79-88db-4f0358e14975 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:55 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:55 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 1073741824 Apr 24 01:11:55 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Delete snapshot completed successfully. Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b', 'name': 'volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '720b02fc-359e-44ab-93dd-aeee7474e24c', 'enforce_multipath': True} {{(pid=81925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-44178f13-4c2d-4d04-acc5-c7b3f9435358-delete_snapshot" released by "delete_snapshot" :: held 2.888s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Snapshots deleted, issuing volume delete {{(pid=81925) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-56ef3ef0-4511-459d-85d3-f0991e84687b" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-56ef3ef0-4511-459d-85d3-f0991e84687b" acquired by "delete_volume" :: waited 0.033s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a970251c-0f61-4b4b-aa49-d1f20f8bb5a8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-13e0310b-0ee9-499d-aa2d-fe9abae700c0 req-b222c072-ee40-4ed8-b445-04ed3e341ef3 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] attachment_update completed successfully. Apr 24 01:11:56 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b Apr 24 01:11:56 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:56 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 1073741824" returned: 0 in 0.735s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:56 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b" returned: 0 in 0.618s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:56 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b Apr 24 01:11:56 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:56 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 Apr 24 01:11:56 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:57 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-56ef3ef0-4511-459d-85d3-f0991e84687b" returned: 0 in 0.481s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-56ef3ef0-4511-459d-85d3-f0991e84687b" released by "delete_volume" :: held 1.168s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:57 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975" returned: 0 in 0.516s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d81dbdf0-f6d8-446e-b6c9-8d324abf7b74,created_at=2026-04-23T23:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843762379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d81dbdf0-f6d8-446e-b6c9-8d324abf7b74,host='devstack@QuobyteHD#QuobyteHD',id=5cff309f-d3ea-4658-b749-d134803b3614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8438387c224e4cbd8d76ae007f3693b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:11:55Z,use_quota=True,user_id='d2c455f12f2240cba7fe180c9408dcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6f5937f-34be-426e-811f-8f2f47f56853),volume_type_id=d6f5937f-34be-426e-811f-8f2f47f56853)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Creating volume 5cff309f-d3ea-4658-b749-d134803b3614 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:11:57 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:57 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 1073741824 Apr 24 01:11:57 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c6cad8-fa7a-472d-b230-5e5e0feb1ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b72302-3231-4d79-88db-4f0358e14975', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962cc2b3-428d-4cb9-9ad5-c3492d4859c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Created reservations ['9452a26b-8214-4df0-b8d8-04a41a8f4fff', '79c34040-cad7-4cea-bfbf-612248367680', 'f3d138eb-2d04-48b3-b887-aa94cab38510', 'bac9cedd-5aa7-4a94-a3df-ab5c721ecb1d'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:57 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Volume volume-77b72302-3231-4d79-88db-4f0358e14975 (77b72302-3231-4d79-88db-4f0358e14975): created successfully Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962cc2b3-428d-4cb9-9ad5-c3492d4859c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Flow 'volume_create_manager' (c87ca0be-7e50-4cb6-9898-04a031e0240a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:57 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b72b7cad-4ac9-4bea-8cb2-bb0e67f0d3b0 tempest-VolumesListTestJSON-1836123599 None] Created volume successfully. Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:57 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:57 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:57 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.569s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:57 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Deleted volume successfully. Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d00c5aeb-c772-41e9-ac34-cff1aee0a822 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-56ef3ef0-4511-459d-85d3-f0991e84687b-delete_volume" released by "delete_volume" :: held 4.987s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:57 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 1073741824" returned: 0 in 0.802s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "cinder-quobyte-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" acquired by "delete_volume" :: waited 0.036s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:11:57 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 Apr 24 01:11:57 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe49e03d-13ba-4415-ab19-b53a7e9ebacc]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:58 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 Apr 24 01:11:58 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:58 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614" returned: 0 in 0.616s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db7b35d-453e-4961-a812-813109c3a19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cff309f-d3ea-4658-b749-d134803b3614', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0efc5a-ef18-4689-90b8-69aba94d24c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:11:58 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Volume volume-5cff309f-d3ea-4658-b749-d134803b3614 (5cff309f-d3ea-4658-b749-d134803b3614): created successfully Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0efc5a-ef18-4689-90b8-69aba94d24c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Flow 'volume_create_manager' (d7748053-0122-47d3-8f48-5933c054e4f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:11:58 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" returned: 0 in 0.668s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:58 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-95d8281f-5d41-41ff-a5c3-46318a686895 tempest-GroupSnapshotsTest-672102948 None] Created volume successfully. Apr 24 01:11:58 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5 Apr 24 01:11:58 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e857e917-4fe5-44bd-92bf-38a0845bc400 tempest-GroupSnapshotsTest-672102948 None] Update group completed successfully. Apr 24 01:11:59 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" returned: 0 in 0.607s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-quobyte-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5" released by "delete_volume" :: held 1.325s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Created reservations ['05eb71a3-ab64-4579-b1a1-26ab34f1d3bf', 'e725a56b-e3a6-4dfc-a250-6761119c340d', 'c5921f16-e2d3-409b-a9eb-dcb5c2cae956', '6fecee3c-1c17-4ea5-a39f-eba779e70a46'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:11:59 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:11:59 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:11:59 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.443s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:11:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Deleted volume successfully. Apr 24 01:11:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89942960-0b45-4750-8bfe-7a03a89d2ec3 tempest-VolumesDeleteCascade-1029263106 None] Lock "cinder-2ba0d137-e528-4cc6-90d2-6bc87eb0cff5-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:00 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-daba0008-189d-4b38-b17b-cb9c014e0795 tempest-GroupSnapshotsTest-672102948 None] Update group completed successfully. Apr 24 01:12:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "cinder-77b72302-3231-4d79-88db-4f0358e14975-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-77b72302-3231-4d79-88db-4f0358e14975-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "cinder-quobyte-77b72302-3231-4d79-88db-4f0358e14975" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-quobyte-77b72302-3231-4d79-88db-4f0358e14975" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:00 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[db763df5-37dd-4c8d-96c0-84a569ff5494]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:00 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 Apr 24 01:12:00 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:01 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975" returned: 0 in 0.691s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:01 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975 Apr 24 01:12:01 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:01 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b742f789-711d-4e3a-93fd-81344312b166 tempest-GroupSnapshotsTest-672102948 None] Update group completed successfully. Apr 24 01:12:02 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-77b72302-3231-4d79-88db-4f0358e14975" returned: 0 in 0.734s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-quobyte-77b72302-3231-4d79-88db-4f0358e14975" released by "delete_volume" :: held 1.467s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Created reservations ['7551700e-8360-4f53-adb6-66f33ddc0ca3', 'd561b14d-1890-4b39-a157-d8b40281cd5b', 'c2503a38-5fad-4470-a5a2-9d3669c3404d', 'cf7be99c-cf7c-408c-8690-7f5dda1688d0'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:02 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:02 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "cinder-906f4ffe-2497-412f-b01e-0317050c0fac-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-906f4ffe-2497-412f-b01e-0317050c0fac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:03 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.907s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:03 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-119210aa-6268-4c0f-9cb7-830f1a4d0e3b tempest-GroupSnapshotsTest-672102948 None] Update group completed successfully. Apr 24 01:12:03 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Deleted volume successfully. Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "cinder-quobyte-906f4ffe-2497-412f-b01e-0317050c0fac" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-quobyte-906f4ffe-2497-412f-b01e-0317050c0fac" acquired by "delete_volume" :: waited 0.034s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c75708a6-4606-493c-a53a-65a81e5a0f8e tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-77b72302-3231-4d79-88db-4f0358e14975-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb472f04-8a7a-4eda-ba40-cd2c15cd1eba]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:03 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac Apr 24 01:12:03 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:03 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac" returned: 0 in 0.623s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:03 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac Apr 24 01:12:03 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:04 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-906f4ffe-2497-412f-b01e-0317050c0fac" returned: 0 in 0.930s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:04 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] GroupSnapshot 74e46bf3-a76a-4a67-b5be-a5d5309964b9: creating. Apr 24 01:12:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-quobyte-906f4ffe-2497-412f-b01e-0317050c0fac" released by "delete_volume" :: held 1.617s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:04 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Group snapshot 74e46bf3-a76a-4a67-b5be-a5d5309964b9: creating. {{(pid=81925) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 01:12:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:04 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Created reservations ['1885dd92-c761-4421-870a-7db4183d5ba7', 'b5dac4c2-71a4-42d4-8b39-107dc833a49c', '2827a5dd-db3b-4726-acfb-b080cad60ed5', '5573593f-58ec-4ef6-b5e8-eb64f3327c72'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Creating offline snapshot 31f583c9-3837-4c08-851e-0897cfeebdba of volume 5cff309f-d3ea-4658-b749-d134803b3614 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4122e520-6585-412c-a399-b362736e8e14]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:05 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:05 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:05 devstack sudo[86307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 Apr 24 01:12:05 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "cinder-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "cinder-quobyte-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-quobyte-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf" acquired by "delete_volume" :: waited 0.039s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e33ee42-ba2a-4952-809e-26dd690b4bba]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:06 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf Apr 24 01:12:06 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:06 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.967s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Deleted volume successfully. Apr 24 01:12:06 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614" returned: 0 in 1.184s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e5bc8f46-e395-4077-9aae-08970dc74f00 tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-906f4ffe-2497-412f-b01e-0317050c0fac-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:06 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba 1G Apr 24 01:12:06 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Flow 'volume_create_manager' (51492e3b-d617-4361-8132-f504c9321261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b652a4-891e-4f7f-9ae1-50c2bba44a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b652a4-891e-4f7f-9ae1-50c2bba44a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1739016381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040336b8-5455-4a29-b4b0-aab95385efdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185eb6973bb4d1eb34272f929dedc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:06Z,use_quota=True,user_id='a309f4e76e244677bacefd28c10a2582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661797d4-82a0-4598-963a-e6ef90f6fb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661797d4-82a0-4598-963a-e6ef90f6fb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5b8c5b-a232-4b38-9add-715ea4d750ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5b8c5b-a232-4b38-9add-715ea4d750ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040336b8-5455-4a29-b4b0-aab95385efdb', 'volume_name': 'volume-040336b8-5455-4a29-b4b0-aab95385efdb', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5462618e-8ab4-4308-b9e8-4dbc067ffe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5462618e-8ab4-4308-b9e8-4dbc067ffe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44a981c-0868-436b-a51f-7ddfe058ef6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:06 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Volume 040336b8-5455-4a29-b4b0-aab95385efdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040336b8-5455-4a29-b4b0-aab95385efdb', 'volume_size': 1} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:06 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf" returned: 0 in 1.055s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:07 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf Apr 24 01:12:07 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:07 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba 1G" returned: 0 in 0.923s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cff309f-d3ea-4658-b749-d134803b3614 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:07 devstack sudo[86329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cff309f-d3ea-4658-b749-d134803b3614 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba Apr 24 01:12:07 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:07 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf" returned: 0 in 0.990s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-quobyte-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf" released by "delete_volume" :: held 2.130s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Created reservations ['eb44a495-a6d7-43e1-a035-7ce23b124df1', '6e148738-b3f3-42f1-b18b-d0c43bbfc5d9', '48a07273-ca90-43be-afa2-1fbee5d3869d', 'd7f31604-a8c9-42bd-947a-64c81a632ffa'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:08 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cff309f-d3ea-4658-b749-d134803b3614 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba" returned: 0 in 0.998s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:08 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:08 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:08 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:08 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba Apr 24 01:12:08 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:08 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.476s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:08 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Deleted volume successfully. Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37f0129f-d21d-484e-81aa-ecb00418f198 tempest-VolumesListTestJSON-1836123599 None] Lock "cinder-8aa87b97-1bda-4c4f-9260-2645ee8a8bcf-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:08 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba" returned: 0 in 0.498s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:08 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.info Apr 24 01:12:08 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:09 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.info" returned: 0 in 0.486s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:09 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:09 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.info Apr 24 01:12:09 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:09 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.info" returned: 0 in 0.685s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.955s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Creating offline snapshot 8a047168-def5-4993-8894-ab1fd7aa5cff of volume b36448f1-33f7-402d-be8c-7e3826317e9c {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90eb644-b149-439f-9711-03226532917d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:10 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c Apr 24 01:12:10 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:10 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c" returned: 0 in 0.902s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:10 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff 1G Apr 24 01:12:10 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:11 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff 1G" returned: 0 in 0.902s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36448f1-33f7-402d-be8c-7e3826317e9c -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:11 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36448f1-33f7-402d-be8c-7e3826317e9c -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff Apr 24 01:12:11 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:11 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:11 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:12 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.806s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:12 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36448f1-33f7-402d-be8c-7e3826317e9c -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff" returned: 0 in 0.888s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:12 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:12 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff Apr 24 01:12:12 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (d196b4cf-64e9-41c4-87e2-e35ed9d6cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7271cb71-465c-42f9-b664-beb536c7f34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7271cb71-465c-42f9-b664-beb536c7f34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327169124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ce2a8-f32f-468c-8bc9-93835c35edaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:13Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa46ae4-07ed-4077-a0c9-569cace4da57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa46ae4-07ed-4077-a0c9-569cace4da57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ebdd60-c57c-4323-82a2-f1dd0003dcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ebdd60-c57c-4323-82a2-f1dd0003dcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407ce2a8-f32f-468c-8bc9-93835c35edaa', 'volume_name': 'volume-407ce2a8-f32f-468c-8bc9-93835c35edaa', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c12513-682d-4d98-937a-96f1ab62b3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c12513-682d-4d98-937a-96f1ab62b3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee563b77-6305-4f86-ae8e-68b777f314f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:12 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume 407ce2a8-f32f-468c-8bc9-93835c35edaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407ce2a8-f32f-468c-8bc9-93835c35edaa', 'volume_size': 1} Apr 24 01:12:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:13 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff" returned: 0 in 0.491s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:13 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.info Apr 24 01:12:13 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:13 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.info" returned: 0 in 0.549s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:13 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:12:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:13 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.info Apr 24 01:12:13 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:14 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.info" returned: 0 in 0.518s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.343s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.746s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1739016381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040336b8-5455-4a29-b4b0-aab95385efdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185eb6973bb4d1eb34272f929dedc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:06Z,use_quota=True,user_id='a309f4e76e244677bacefd28c10a2582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Creating volume 040336b8-5455-4a29-b4b0-aab95385efdb {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:14 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:14 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb 1073741824 Apr 24 01:12:14 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:14 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-7a6bc437-5335-4f25-a274-68366e590c4c tempest-GroupSnapshotsTest-672102948 None] group_snapshot 74e46bf3-a76a-4a67-b5be-a5d5309964b9: created successfully Apr 24 01:12:14 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb 1073741824" returned: 0 in 0.722s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:15 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb Apr 24 01:12:15 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:15 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb" returned: 0 in 0.506s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.683s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327169124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ce2a8-f32f-468c-8bc9-93835c35edaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:13Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Creating volume 407ce2a8-f32f-468c-8bc9-93835c35edaa {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:15 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:15 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa 1073741824 Apr 24 01:12:15 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44a981c-0868-436b-a51f-7ddfe058ef6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040336b8-5455-4a29-b4b0-aab95385efdb', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edef5c85-fdb6-4cf2-9097-199cf6dd8fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:15 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] group_snapshot 74e46bf3-a76a-4a67-b5be-a5d5309964b9: deleting Apr 24 01:12:15 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Volume volume-040336b8-5455-4a29-b4b0-aab95385efdb (040336b8-5455-4a29-b4b0-aab95385efdb): created successfully Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edef5c85-fdb6-4cf2-9097-199cf6dd8fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Flow 'volume_create_manager' (51492e3b-d617-4361-8132-f504c9321261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:15 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2ead9fb8-c55c-4e59-a1de-31f2d4eceddd tempest-VolumesTransfersTest-1643198318 None] Created volume successfully. Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] group_snapshot 74e46bf3-a76a-4a67-b5be-a5d5309964b9: deleting {{(pid=81925) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-5cff309f-d3ea-4658-b749-d134803b3614" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-5cff309f-d3ea-4658-b749-d134803b3614" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-31f583c9-3837-4c08-851e-0897cfeebdba" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-31f583c9-3837-4c08-851e-0897cfeebdba" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Deleting offline snapshot 31f583c9-3837-4c08-851e-0897cfeebdba of volume 5cff309f-d3ea-4658-b749-d134803b3614 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] snapshot_file for this snap is: volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2eee74-3ff6-4aa5-bbba-9f9977f55837]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:15 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba Apr 24 01:12:15 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:16 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa 1073741824" returned: 0 in 0.872s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:16 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa Apr 24 01:12:16 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:16 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba" returned: 0 in 0.787s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cff309f-d3ea-4658-b749-d134803b3614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:12:16 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fe79e2-966a-4506-aec5-c66ed865c2f2]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:16 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 Apr 24 01:12:16 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:16 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-381a63e8-ec43-4522-897c-3620bdc13d01 tempest-VolumesTransfersTest-281767814 None] Transfer volume completed successfully. Apr 24 01:12:17 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa" returned: 0 in 0.532s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee563b77-6305-4f86-ae8e-68b777f314f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407ce2a8-f32f-468c-8bc9-93835c35edaa', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a3d322-c72d-4a02-9446-7dce3b5438a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:17 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume volume-407ce2a8-f32f-468c-8bc9-93835c35edaa (407ce2a8-f32f-468c-8bc9-93835c35edaa): created successfully Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a3d322-c72d-4a02-9446-7dce3b5438a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (d196b4cf-64e9-41c4-87e2-e35ed9d6cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:17 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f6671dfc-c1a3-4dcd-87f2-ff872704df17 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created volume successfully. Apr 24 01:12:17 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614" returned: 0 in 0.642s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:17 devstack sudo[86484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba Apr 24 01:12:17 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Acquiring lock "cinder-040336b8-5455-4a29-b4b0-aab95385efdb-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:17 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba" returned: 0 in 0.651s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Lock "cinder-040336b8-5455-4a29-b4b0-aab95385efdb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:17 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba Apr 24 01:12:17 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Acquiring lock "cinder-quobyte-040336b8-5455-4a29-b4b0-aab95385efdb" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Lock "cinder-quobyte-040336b8-5455-4a29-b4b0-aab95385efdb" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7964e7-1e28-435d-a82d-decb7e2c6b07]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:18 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb Apr 24 01:12:18 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Creating offline snapshot 734b5d10-d998-4498-b2b8-1f45ca0fe3a5 of volume 407ce2a8-f32f-468c-8bc9-93835c35edaa {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d673f71e-c8fd-46fc-93ca-f842e8dca2fa]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:18 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa Apr 24 01:12:18 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:18 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614.31f583c9-3837-4c08-851e-0897cfeebdba" returned: 0 in 0.581s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-31f583c9-3837-4c08-851e-0897cfeebdba" released by "_delete_snapshot" :: held 2.779s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-5cff309f-d3ea-4658-b749-d134803b3614" released by "delete_snapshot" :: held 2.812s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-b36448f1-33f7-402d-be8c-7e3826317e9c" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-b36448f1-33f7-402d-be8c-7e3826317e9c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-8a047168-def5-4993-8894-ab1fd7aa5cff" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-8a047168-def5-4993-8894-ab1fd7aa5cff" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:18 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Deleting offline snapshot 8a047168-def5-4993-8894-ab1fd7aa5cff of volume b36448f1-33f7-402d-be8c-7e3826317e9c {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] snapshot_file for this snap is: volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb" returned: 0 in 0.615s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5940142b-1c96-41b0-8bb7-384f1bb56902]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:18 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb Apr 24 01:12:18 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:18 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff Apr 24 01:12:18 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:19 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa" returned: 0 in 0.726s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:19 devstack sudo[86513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 1G Apr 24 01:12:19 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:19 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-040336b8-5455-4a29-b4b0-aab95385efdb" returned: 0 in 0.631s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Lock "cinder-quobyte-040336b8-5455-4a29-b4b0-aab95385efdb" released by "delete_volume" :: held 1.284s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=146,cinder:INSERT=41,cinder:UPDATE=163,cinder:DELETE=14 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:12:19 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff" returned: 0 in 0.651s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b36448f1-33f7-402d-be8c-7e3826317e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5072067b-6f27-42cd-8a40-b27f855fda75]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=150,cinder:UPDATE=139,cinder:INSERT=40,cinder:DELETE=6 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Created reservations ['67602e1d-6b8f-4213-a656-5a94c620f820', 'd9e9e49c-7673-4423-afac-849b1f0b6076', 'c2ac603e-d97b-4916-90d2-e4d52efd805e', '48736c46-bb40-4538-a6ad-27122e3d4281'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:19 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c Apr 24 01:12:19 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:19 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:19 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:19 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 1G" returned: 0 in 0.764s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ce2a8-f32f-468c-8bc9-93835c35edaa -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:19 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ce2a8-f32f-468c-8bc9-93835c35edaa -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 Apr 24 01:12:19 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:19 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c" returned: 0 in 0.635s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:19 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff Apr 24 01:12:20 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:20 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.551s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:20 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Deleted volume successfully. Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7d01b53f-3e4a-49f1-b1d3-965ecd201fc2 tempest-VolumesTransfersTest-1646002828 None] Lock "cinder-040336b8-5455-4a29-b4b0-aab95385efdb-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:20 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ce2a8-f32f-468c-8bc9-93835c35edaa -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5" returned: 0 in 0.966s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:20 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 is being set with open permissions: ugo+rw Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:20 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 Apr 24 01:12:20 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Flow 'volume_create_manager' (bc092ef9-46af-40a6-ae23-a13112edfad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2924a561-fee1-4ed5-876d-efbb0c3400d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2924a561-fee1-4ed5-876d-efbb0c3400d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1638059781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952a3396-a070-479d-91a7-70fca3a388e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185eb6973bb4d1eb34272f929dedc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:21Z,use_quota=True,user_id='a309f4e76e244677bacefd28c10a2582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bed7db6-d80c-4153-9485-ffcb2b607723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bed7db6-d80c-4153-9485-ffcb2b607723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e8fb0-d41d-4d2e-9291-0c6f4c3d28af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e8fb0-d41d-4d2e-9291-0c6f4c3d28af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '952a3396-a070-479d-91a7-70fca3a388e0', 'volume_name': 'volume-952a3396-a070-479d-91a7-70fca3a388e0', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183d75a4-a244-4de1-b762-e592cd3be219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183d75a4-a244-4de1-b762-e592cd3be219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f35a8b-7897-4282-99fa-21fad69890cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:21 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Volume 952a3396-a070-479d-91a7-70fca3a388e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-952a3396-a070-479d-91a7-70fca3a388e0', 'volume_size': 1} Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:21 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff" returned: 0 in 1.348s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:21 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff Apr 24 01:12:21 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:21 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5" returned: 0 in 0.717s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:21 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.info Apr 24 01:12:21 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:21 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c.8a047168-def5-4993-8894-ab1fd7aa5cff" returned: 0 in 0.546s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-8a047168-def5-4993-8894-ab1fd7aa5cff" released by "_delete_snapshot" :: held 3.314s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-b36448f1-33f7-402d-be8c-7e3826317e9c" released by "delete_snapshot" :: held 3.346s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:22 devstack cinder-volume[81925]: WARNING cinder.quota [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1497367714 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1497367714, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:12:22 devstack cinder-volume[81925]: WARNING cinder.quota [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1497367714 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1497367714, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Created reservations ['cdc7b9d5-f927-4bbb-a861-9a2fd102ee2e', '2064f460-756b-4f5f-98d8-6846fc5632aa', '2b428b00-3341-4f40-88e7-4609029730ce', '9b3551c1-7795-4f65-8cb7-b82e2cc8d3e4'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:22 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.info" returned: 0 in 0.659s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:22 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.info is being set with open permissions: ugo+rw Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] Created reservations ['f621e591-33ce-45c7-a7f6-e9495ee10f5b', '59b12bb7-4943-4239-b083-ae7cdb68a91e', '7a9b17f5-16d5-4ae9-940b-e9c306cec36d', '753dc122-c8c6-4660-9e20-b2734feab6bc'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:22 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.info Apr 24 01:12:22 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-89dddf30-e969-4acc-8479-cfd1ab5ceac3 tempest-GroupSnapshotsTest-672102948 None] group_snapshot 74e46bf3-a76a-4a67-b5be-a5d5309964b9: deleted successfully Apr 24 01:12:22 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.info" returned: 0 in 0.519s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.483s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1638059781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952a3396-a070-479d-91a7-70fca3a388e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185eb6973bb4d1eb34272f929dedc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:21Z,use_quota=True,user_id='a309f4e76e244677bacefd28c10a2582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Creating volume 952a3396-a070-479d-91a7-70fca3a388e0 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:22 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:22 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 1073741824 Apr 24 01:12:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a3ee2c12-4dfb-4d80-bf7f-bbad0c4530f5 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Create snapshot completed successfully Apr 24 01:12:22 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-5cff309f-d3ea-4658-b749-d134803b3614" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-5cff309f-d3ea-4658-b749-d134803b3614" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:23 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a12f206-d90a-4c32-8993-853aae03f201]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:23 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 Apr 24 01:12:23 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:23 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 1073741824" returned: 0 in 1.115s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:23 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 Apr 24 01:12:23 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (f1d91e94-34aa-4e6e-b75d-7571115a23f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ad8c22-503d-4739-9fe8-22c4f560b526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ad8c22-503d-4739-9fe8-22c4f560b526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439236209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4d8e9e-aaa5-48a7-8aee-64b2657ea767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:24Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de65e7f-2286-4eda-ab11-241feac46ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de65e7f-2286-4eda-ab11-241feac46ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a32de5-62f1-4002-a6bb-3464a5c624d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a32de5-62f1-4002-a6bb-3464a5c624d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb4d8e9e-aaa5-48a7-8aee-64b2657ea767', 'volume_name': 'volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3355c853-dc6a-429a-8961-62d613138c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3355c853-dc6a-429a-8961-62d613138c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40f013b-383a-463f-99c3-2f7e59564bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:24 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume eb4d8e9e-aaa5-48a7-8aee-64b2657ea767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767', 'volume_size': 1} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:24 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614" returned: 0 in 0.814s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:24 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614 Apr 24 01:12:24 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (97dac20b-3687-4772-b855-e303da265561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad0c305-1ac7-4da5-a27f-616f7b89ab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad0c305-1ac7-4da5-a27f-616f7b89ab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305618246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7c82cd-d54f-496f-b111-b9a3ed9c981a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:25Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9a0d24-b049-4f65-8443-2cf605e2085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9a0d24-b049-4f65-8443-2cf605e2085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7142f40b-2fcc-4373-acdd-8056c4f8949f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7142f40b-2fcc-4373-acdd-8056c4f8949f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7c82cd-d54f-496f-b111-b9a3ed9c981a', 'volume_name': 'volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df94cd70-85fe-4aec-b5f5-3f8d38f56ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df94cd70-85fe-4aec-b5f5-3f8d38f56ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e45395-32a2-4d85-a31e-0483b3c67ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume 0e7c82cd-d54f-496f-b111-b9a3ed9c981a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a', 'volume_size': 1} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:25 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0" returned: 0 in 1.348s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.533s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.976s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439236209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4d8e9e-aaa5-48a7-8aee-64b2657ea767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:24Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Creating volume eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:25 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (e0d01b5e-fb87-4bcf-af6a-30c8cf554298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747d6285-1853-4ac1-a666-5fea95022de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 1073741824 Apr 24 01:12:25 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747d6285-1853-4ac1-a666-5fea95022de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1088282773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cc3282-5d5f-4de2-8931-853e4c13aa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:25Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bedb5ab-0500-4f0b-b8a8-ec40008366b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bedb5ab-0500-4f0b-b8a8-ec40008366b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99edcc26-78af-4b79-b26e-76c2782456da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99edcc26-78af-4b79-b26e-76c2782456da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4cc3282-5d5f-4de2-8931-853e4c13aa60', 'volume_name': 'volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27ace3b-2d31-43be-b957-cc2dc9e55b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27ace3b-2d31-43be-b957-cc2dc9e55b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efdbe50-ade2-4ef5-a8e0-32d0b97c6049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume c4cc3282-5d5f-4de2-8931-853e4c13aa60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60', 'volume_size': 1} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f35a8b-7897-4282-99fa-21fad69890cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952a3396-a070-479d-91a7-70fca3a388e0', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb3ebcb-4b85-4c22-a6b7-4ac0dcb7c96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Volume volume-952a3396-a070-479d-91a7-70fca3a388e0 (952a3396-a070-479d-91a7-70fca3a388e0): created successfully Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb3ebcb-4b85-4c22-a6b7-4ac0dcb7c96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Flow 'volume_create_manager' (bc092ef9-46af-40a6-ae23-a13112edfad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:25 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b6a15ef5-ed27-47e9-9be7-0780740a3ba8 tempest-VolumesTransfersTest-1643198318 None] Created volume successfully. Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (5a70ba52-3f20-47bd-bf3d-92de7ead9615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b02432a-d3d6-4521-b921-b97b7723bee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b02432a-d3d6-4521-b921-b97b7723bee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1113439322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838fa97c-71b8-4a02-9cd6-b7cc7a919967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:25Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85db2db2-7e53-45a2-9e4d-89761a9e163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85db2db2-7e53-45a2-9e4d-89761a9e163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112314bb-abb0-4108-b75b-8bf64177e50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112314bb-abb0-4108-b75b-8bf64177e50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838fa97c-71b8-4a02-9cd6-b7cc7a919967', 'volume_name': 'volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623d4adf-8e1b-4812-a286-ca1db56fd541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623d4adf-8e1b-4812-a286-ca1db56fd541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e50d32-8ccf-4d7b-8927-548a9c8a41c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume 838fa97c-71b8-4a02-9cd6-b7cc7a919967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967', 'volume_size': 1} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5cff309f-d3ea-4658-b749-d134803b3614" returned: 0 in 1.251s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-5cff309f-d3ea-4658-b749-d134803b3614" released by "delete_volume" :: held 2.160s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-b36448f1-33f7-402d-be8c-7e3826317e9c" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-b36448f1-33f7-402d-be8c-7e3826317e9c" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[332829fb-f1ad-4a4b-bd42-3f8c8731a3b4]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:25 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c Apr 24 01:12:25 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:25 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (72fbd29c-a58c-4d85-9b1a-e2be2bfe2b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01303406-c6a5-43f2-b901-d3c38dc8936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01303406-c6a5-43f2-b901-d3c38dc8936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-689871166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4ad344-9043-473f-83bc-4cf3767f382a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:26Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25934f2-c861-46a6-8731-c450ad1b8f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25934f2-c861-46a6-8731-c450ad1b8f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ed5895-91a3-436f-a592-7036ce9825b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ed5895-91a3-436f-a592-7036ce9825b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4ad344-9043-473f-83bc-4cf3767f382a', 'volume_name': 'volume-7f4ad344-9043-473f-83bc-4cf3767f382a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebc282b-e62d-482e-b57d-4c7054cf6c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebc282b-e62d-482e-b57d-4c7054cf6c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1aeba7-1800-4c5f-888b-21988273d69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:26 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume 7f4ad344-9043-473f-83bc-4cf3767f382a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4ad344-9043-473f-83bc-4cf3767f382a', 'volume_size': 1} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:26 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 1073741824" returned: 0 in 1.195s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:26 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 Apr 24 01:12:26 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:26 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c" returned: 0 in 0.885s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:26 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c Apr 24 01:12:26 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Acquiring lock "cinder-952a3396-a070-479d-91a7-70fca3a388e0-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Lock "cinder-952a3396-a070-479d-91a7-70fca3a388e0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Acquiring lock "cinder-quobyte-952a3396-a070-479d-91a7-70fca3a388e0" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Lock "cinder-quobyte-952a3396-a070-479d-91a7-70fca3a388e0" acquired by "delete_volume" :: waited 0.027s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f354ce8-4499-4b53-adbe-169a3680b84f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:27 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 Apr 24 01:12:27 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:27 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767" returned: 0 in 0.709s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.184s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305618246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7c82cd-d54f-496f-b111-b9a3ed9c981a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:25Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Creating volume 0e7c82cd-d54f-496f-b111-b9a3ed9c981a {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:27 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40f013b-383a-463f-99c3-2f7e59564bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:27 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a 1073741824 Apr 24 01:12:27 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e42fc9d-6d9f-4e5d-82f2-3b59e036e705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:27 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b36448f1-33f7-402d-be8c-7e3826317e9c" returned: 0 in 0.671s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:27 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 (eb4d8e9e-aaa5-48a7-8aee-64b2657ea767): created successfully Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e42fc9d-6d9f-4e5d-82f2-3b59e036e705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (f1d91e94-34aa-4e6e-b75d-7571115a23f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-b36448f1-33f7-402d-be8c-7e3826317e9c" released by "delete_volume" :: held 1.652s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:27 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-295084d3-cd00-4c18-8723-ba17f226a376 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created volume successfully. Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Created reservations ['448c1542-f08b-4fc6-9730-a5e9fd1b4800'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:27 devstack cinder-volume[81925]: WARNING cinder.quota [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1497367714 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1497367714, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Created reservations ['84240393-c1ae-4c92-993b-b0ab4926a2de', '0cca4986-a8b4-4eca-a5fa-e2dde7d3f107', 'e3819f46-de58-4d2b-9399-5f8db19f2218', '7ee5a106-de84-4088-8c8c-317d20ad74b0'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Created reservations ['639dda00-f124-4d39-be54-4f347161dd39', 'e449e96e-ce47-4314-a3ef-c82c91fd3d1c', 'd0f57a9a-e9c6-4a6f-b002-dccfabb32734', 'f61b6ed7-8f71-4313-91a8-d39bfb6dd0e8'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:27 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0" returned: 0 in 0.752s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:27 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0 Apr 24 01:12:27 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:27 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:27 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:28 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a 1073741824" returned: 0 in 1.083s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:28 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-952a3396-a070-479d-91a7-70fca3a388e0" returned: 0 in 0.675s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Lock "cinder-quobyte-952a3396-a070-479d-91a7-70fca3a388e0" released by "delete_volume" :: held 1.484s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:28 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a Apr 24 01:12:28 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Created reservations ['f1601c03-d99a-4a93-b219-a72747e9639c', '38e702bd-e980-40d7-b40d-d37b47d3047c', '24cc454d-ef0b-487a-b428-aa803e6cea51', '86a99447-642b-4afe-8235-c8151bc2a7ff'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:28 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.665s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5d06e142-54e3-42e7-ad09-5a389e79d301 tempest-GroupSnapshotsTest-672102948 None] Delete group completed successfully. Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:28 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:28 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-73cde42a-8242-4ef5-8ae5-bcf2403cf4d0 tempest-GroupSnapshotsTest-672102948 None] Group tempest-GroupSnapshotsTest-Group-266928806: creating Apr 24 01:12:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-73cde42a-8242-4ef5-8ae5-bcf2403cf4d0 tempest-GroupSnapshotsTest-672102948 None] Group tempest-GroupSnapshotsTest-Group-266928806: created successfully Apr 24 01:12:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-73cde42a-8242-4ef5-8ae5-bcf2403cf4d0 tempest-GroupSnapshotsTest-672102948 None] Create group completed successfully. Apr 24 01:12:29 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a" returned: 0 in 0.944s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.950s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1088282773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cc3282-5d5f-4de2-8931-853e4c13aa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:25Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Creating volume c4cc3282-5d5f-4de2-8931-853e4c13aa60 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:29 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e45395-32a2-4d85-a31e-0483b3c67ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:29 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 1073741824 Apr 24 01:12:29 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74de8d09-f6a7-443e-855d-25452b790850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:29 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:29 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a (0e7c82cd-d54f-496f-b111-b9a3ed9c981a): created successfully Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74de8d09-f6a7-443e-855d-25452b790850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (97dac20b-3687-4772-b855-e303da265561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.978s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Deleted volume successfully. Apr 24 01:12:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-566fa345-a19d-46e7-a908-8a3ef2e64cfa tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created volume successfully. Apr 24 01:12:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ffda0ea9-794f-4506-8d80-2bdabb325deb tempest-VolumesTransfersTest-1646002828 None] Lock "cinder-952a3396-a070-479d-91a7-70fca3a388e0-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:30 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 1073741824" returned: 0 in 1.097s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:30 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 Apr 24 01:12:30 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Flow 'volume_create_manager' (a4e7f653-ffa7-4c31-975a-12b7760f9b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b61554b-87f6-469b-a7a0-cb263809762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b61554b-87f6-469b-a7a0-cb263809762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-179017508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0701bc3c-ab86-4379-9fd3-50935e8b0c9f,host='devstack@QuobyteHD#QuobyteHD',id=456b16ff-9407-4070-9d7b-cdb984ca705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8438387c224e4cbd8d76ae007f3693b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:31Z,use_quota=True,user_id='d2c455f12f2240cba7fe180c9408dcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d1f1194-ac06-4984-abab-9ef8e6c5a3e7),volume_type_id=4d1f1194-ac06-4984-abab-9ef8e6c5a3e7)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8319cc9-f953-4934-bdac-f02da42a174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8319cc9-f953-4934-bdac-f02da42a174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdcdde4-1c3b-459d-964e-f39e53fdd3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdcdde4-1c3b-459d-964e-f39e53fdd3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456b16ff-9407-4070-9d7b-cdb984ca705b', 'volume_name': 'volume-456b16ff-9407-4070-9d7b-cdb984ca705b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3242f72-85ec-40b3-acb5-5c6b5c53c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3242f72-85ec-40b3-acb5-5c6b5c53c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83682772-01e0-4082-abe5-8ebf17defa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:31 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Volume 456b16ff-9407-4070-9d7b-cdb984ca705b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456b16ff-9407-4070-9d7b-cdb984ca705b', 'volume_size': 1} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:31 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60" returned: 0 in 0.908s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.799s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1113439322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838fa97c-71b8-4a02-9cd6-b7cc7a919967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:25Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Creating volume 838fa97c-71b8-4a02-9cd6-b7cc7a919967 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:31 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efdbe50-ade2-4ef5-a8e0-32d0b97c6049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abecb827-abe4-40cc-bc8a-39b71323e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:31 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 1073741824 Apr 24 01:12:31 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 (c4cc3282-5d5f-4de2-8931-853e4c13aa60): created successfully Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abecb827-abe4-40cc-bc8a-39b71323e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (e0d01b5e-fb87-4bcf-af6a-30c8cf554298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:31 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:31 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-3fd57c43-6f85-4196-b16b-bcec41f4cde2 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created volume successfully. Apr 24 01:12:32 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 1073741824" returned: 0 in 1.078s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:32 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 Apr 24 01:12:32 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:33 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967" returned: 0 in 0.789s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.306s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-689871166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4ad344-9043-473f-83bc-4cf3767f382a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f77492fa63474aa302d69b2291e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:26Z,use_quota=True,user_id='ef2409c8fc4349f7bd62d796d39bf9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Creating volume 7f4ad344-9043-473f-83bc-4cf3767f382a {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:33 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e50d32-8ccf-4d7b-8927-548a9c8a41c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d29b53d-1c61-4841-aa98-33c673f2b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:33 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 (838fa97c-71b8-4a02-9cd6-b7cc7a919967): created successfully Apr 24 01:12:33 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a 1073741824 Apr 24 01:12:33 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d29b53d-1c61-4841-aa98-33c673f2b224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (5a70ba52-3f20-47bd-bf3d-92de7ead9615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:33 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-275cc0d4-dc6f-471d-b894-0a27eb575882 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created volume successfully. Apr 24 01:12:34 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a 1073741824" returned: 0 in 0.876s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:34 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a Apr 24 01:12:34 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:35 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a" returned: 0 in 0.683s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.973s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0701bc3c-ab86-4379-9fd3-50935e8b0c9f,created_at=2026-04-23T23:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-179017508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0701bc3c-ab86-4379-9fd3-50935e8b0c9f,host='devstack@QuobyteHD#QuobyteHD',id=456b16ff-9407-4070-9d7b-cdb984ca705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8438387c224e4cbd8d76ae007f3693b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:31Z,use_quota=True,user_id='d2c455f12f2240cba7fe180c9408dcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d1f1194-ac06-4984-abab-9ef8e6c5a3e7),volume_type_id=4d1f1194-ac06-4984-abab-9ef8e6c5a3e7)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Creating volume 456b16ff-9407-4070-9d7b-cdb984ca705b {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:35 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:35 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b 1073741824 Apr 24 01:12:35 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1aeba7-1800-4c5f-888b-21988273d69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4ad344-9043-473f-83bc-4cf3767f382a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f66d86-117c-432c-8b30-baa77795eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:35 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Volume volume-7f4ad344-9043-473f-83bc-4cf3767f382a (7f4ad344-9043-473f-83bc-4cf3767f382a): created successfully Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f66d86-117c-432c-8b30-baa77795eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Flow 'volume_create_manager' (72fbd29c-a58c-4d85-9b1a-e2be2bfe2b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:35 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-038827b8-0c8c-4de2-b56f-ef2a56f00c6d tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created volume successfully. Apr 24 01:12:35 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b 1073741824" returned: 0 in 0.752s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:35 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b Apr 24 01:12:35 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-7f4ad344-9043-473f-83bc-4cf3767f382a-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:36 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-945b0527-18a7-49af-9eb0-43eefaf6c77b tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Terminate volume connection completed successfully. Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-945b0527-18a7-49af-9eb0-43eefaf6c77b tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Deleting attachment 720b02fc-359e-44ab-93dd-aeee7474e24c. {{(pid=81925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-7f4ad344-9043-473f-83bc-4cf3767f382a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-quobyte-7f4ad344-9043-473f-83bc-4cf3767f382a" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-7f4ad344-9043-473f-83bc-4cf3767f382a" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[efac3fbc-da47-4c30-805f-3fc00530e376]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:36 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a Apr 24 01:12:36 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:36 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b" returned: 0 in 0.628s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83682772-01e0-4082-abe5-8ebf17defa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456b16ff-9407-4070-9d7b-cdb984ca705b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63de010-555b-4af8-b28f-a6e9f248c0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:36 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Volume volume-456b16ff-9407-4070-9d7b-cdb984ca705b (456b16ff-9407-4070-9d7b-cdb984ca705b): created successfully Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63de010-555b-4af8-b28f-a6e9f248c0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Flow 'volume_create_manager' (a4e7f653-ffa7-4c31-975a-12b7760f9b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:36 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-25aec5a8-2836-4759-bf1f-1a09ce5c25b5 tempest-GroupSnapshotsTest-672102948 None] Created volume successfully. Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "cinder-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "cinder-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:37 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] GroupSnapshot 592f6739-0cfa-438c-865e-97259e2c9448: creating. Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "cinder-quobyte-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Group snapshot 592f6739-0cfa-438c-865e-97259e2c9448: creating. {{(pid=81925) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "cinder-quobyte-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" acquired by "delete_volume" :: waited 0.047s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Creating offline snapshot 57930566-05e8-4154-a562-8bac535be1a0 of volume 456b16ff-9407-4070-9d7b-cdb984ca705b {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[945b65aa-a542-4264-b3b3-4cdaca07e203]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25ab63-4956-45f2-8e46-dba4fd45b30d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:37 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a" returned: 0 in 0.786s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:37 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a Apr 24 01:12:37 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:37 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:12:37 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:37 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b Apr 24 01:12:37 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:37 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b" returned: 0 in 0.673s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:37 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 1G Apr 24 01:12:37 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:37 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 0 in 0.791s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:38 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7f4ad344-9043-473f-83bc-4cf3767f382a" returned: 0 in 0.763s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-7f4ad344-9043-473f-83bc-4cf3767f382a" released by "delete_volume" :: held 1.628s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created reservations ['c4bd9754-e078-4040-bae1-14fbe0d30cb2', '8fbb51b0-98ad-473c-9ae5-df0c9903d7e6', 'bd7541d9-c238-469c-a8c0-062793654302', '562c0b02-26f0-457c-8c14-99f8e93dfae0'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:38 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:12:38 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:38 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:38 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-838fa97c-71b8-4a02-9cd6-b7cc7a919967-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-838fa97c-71b8-4a02-9cd6-b7cc7a919967-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-quobyte-838fa97c-71b8-4a02-9cd6-b7cc7a919967" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:38 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 1 in 0.872s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-838fa97c-71b8-4a02-9cd6-b7cc7a919967" acquired by "delete_volume" :: waited 0.055s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:38 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:38 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1 Apr 24 01:12:38 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 1G" returned: 0 in 1.034s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456b16ff-9407-4070-9d7b-cdb984ca705b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabf11f3-f365-4ca7-9a58-4a0660e14a92]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:38 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:38 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456b16ff-9407-4070-9d7b-cdb984ca705b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 Apr 24 01:12:38 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.785s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:38 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:38 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Deleted volume successfully. Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Flow 'volume_create_manager' (918dbb65-0b7b-4ac3-89f0-eb05361b33e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:39 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 Apr 24 01:12:39 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663c45a0-b12b-422a-9f25-114afead19e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a627d41e-cc2e-4027-9674-4f8dae19650b tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-7f4ad344-9043-473f-83bc-4cf3767f382a-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663c45a0-b12b-422a-9f25-114afead19e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1898140560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1b4923-db72-4ea0-a330-f7d103fd786d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85513db39e6b4bb9a1654048dd80461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:39Z,use_quota=True,user_id='35f9f7d56f74449dbc66c2423ac1334f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a15b1a9-4ad7-4706-b27c-8b259e6b80c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a15b1a9-4ad7-4706-b27c-8b259e6b80c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d371bfe6-6493-4724-af12-1ff393298d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d371bfe6-6493-4724-af12-1ff393298d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1b4923-db72-4ea0-a330-f7d103fd786d', 'volume_name': 'volume-ab1b4923-db72-4ea0-a330-f7d103fd786d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b452a3fb-2728-4cc8-9ca7-c92ba96963cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b452a3fb-2728-4cc8-9ca7-c92ba96963cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a6b638-6de7-481f-a5c0-5a87ef7f100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:39 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Volume ab1b4923-db72-4ea0-a330-f7d103fd786d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1b4923-db72-4ea0-a330-f7d103fd786d', 'volume_size': 1} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:39 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" returned: 0 in 0.586s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "cinder-quobyte-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1" released by "delete_volume" :: held 2.352s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.quota [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Created reservations ['b51d1083-99f7-4728-bc51-9dc07650dacc', '37c46354-9d0b-4bc8-891b-665857d82e33', '2505c0bd-352c-4294-b778-e65f6ff36f6b', '2bfcb049-9063-4d93-b37e-70d8edcd323f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:39 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:39 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967" returned: 0 in 0.655s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456b16ff-9407-4070-9d7b-cdb984ca705b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0" returned: 0 in 0.675s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:39 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:39 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967 Apr 24 01:12:39 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:39 devstack sudo[86848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 Apr 24 01:12:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:39 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:39 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:39 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:40 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0" returned: 0 in 0.508s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:40 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-838fa97c-71b8-4a02-9cd6-b7cc7a919967" returned: 0 in 0.532s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-838fa97c-71b8-4a02-9cd6-b7cc7a919967" released by "delete_volume" :: held 1.266s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:40 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.590s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG cinder.manager [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:40 devstack sudo[86856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.info Apr 24 01:12:40 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Deleted volume successfully. Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-10790dd2-abee-462b-a4cb-2f26b251b650 req-b22b7af1-458e-4c9f-b4ec-6c90fa9e29f7 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "cinder-9e3f3aa0-cfb5-45b3-b2e7-ccf0f99951a1-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created reservations ['c36a3790-8f5a-45ff-bc42-51770bdba608', 'cff380bd-617b-4cfa-85de-bb2e0ce3484d', '61b16c0c-266a-40b5-9d89-9173c562182a', 'f8c52f82-76b8-4c8d-a7f2-eb5b99fcb130'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:40 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:40 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:40 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.info" returned: 0 in 0.613s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:40 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:40 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.info Apr 24 01:12:40 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:40 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.554s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:40 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Deleted volume successfully. Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-c4cc3282-5d5f-4de2-8931-853e4c13aa60-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5866aaa-a229-411e-8761-f502e2ad28e1 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-838fa97c-71b8-4a02-9cd6-b7cc7a919967-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-c4cc3282-5d5f-4de2-8931-853e4c13aa60-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-quobyte-c4cc3282-5d5f-4de2-8931-853e4c13aa60" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-c4cc3282-5d5f-4de2-8931-853e4c13aa60" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[976ac7ed-fdbc-462a-a9d6-0b29c043458c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:41 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 Apr 24 01:12:41 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:41 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.info" returned: 0 in 0.553s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.260s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.280s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1898140560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1b4923-db72-4ea0-a330-f7d103fd786d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85513db39e6b4bb9a1654048dd80461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:39Z,use_quota=True,user_id='35f9f7d56f74449dbc66c2423ac1334f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Creating volume ab1b4923-db72-4ea0-a330-f7d103fd786d {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:41 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:41 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d 1073741824 Apr 24 01:12:41 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:41 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b846af32-3abf-46cf-8688-2b3eb7af8f8e tempest-GroupSnapshotsTest-672102948 None] group_snapshot 592f6739-0cfa-438c-865e-97259e2c9448: created successfully Apr 24 01:12:41 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60" returned: 0 in 0.602s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:41 devstack sudo[86881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60 Apr 24 01:12:41 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:42 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d 1073741824" returned: 0 in 0.893s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:42 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d Apr 24 01:12:42 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:42 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c4cc3282-5d5f-4de2-8931-853e4c13aa60" returned: 0 in 0.741s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-c4cc3282-5d5f-4de2-8931-853e4c13aa60" released by "delete_volume" :: held 1.394s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] group_snapshot 592f6739-0cfa-438c-865e-97259e2c9448: deleting Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created reservations ['398294f2-0fc7-4a2e-b453-95dc4c646f04', 'd75cdafd-217a-4b9e-b511-bd150b3d4617', 'a1340b7b-e9dd-4b4e-a5c1-b0b9113ba1ba', '126672d9-c5fa-4bd3-bfe9-a4cb06d0141e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] group_snapshot 592f6739-0cfa-438c-865e-97259e2c9448: deleting {{(pid=81925) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-456b16ff-9407-4070-9d7b-cdb984ca705b" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-456b16ff-9407-4070-9d7b-cdb984ca705b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-57930566-05e8-4154-a562-8bac535be1a0" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-57930566-05e8-4154-a562-8bac535be1a0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Deleting offline snapshot 57930566-05e8-4154-a562-8bac535be1a0 of volume 456b16ff-9407-4070-9d7b-cdb984ca705b {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] snapshot_file for this snap is: volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9429a4d-709d-4239-9a0b-8d3d71236cd8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:42 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:42 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:42 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 Apr 24 01:12:42 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:42 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d" returned: 0 in 0.551s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a6b638-6de7-481f-a5c0-5a87ef7f100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1b4923-db72-4ea0-a330-f7d103fd786d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed1e001-94fa-4a5e-b94a-84d67b8a90ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:42 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Volume volume-ab1b4923-db72-4ea0-a330-f7d103fd786d (ab1b4923-db72-4ea0-a330-f7d103fd786d): created successfully Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed1e001-94fa-4a5e-b94a-84d67b8a90ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Flow 'volume_create_manager' (918dbb65-0b7b-4ac3-89f0-eb05361b33e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b7b32555-e27d-4972-b286-3e32e9a4233d tempest-VolumesTransfersV355Test-1499264264 None] Created volume successfully. Apr 24 01:12:43 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.562s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:43 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Deleted volume successfully. Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-116d728d-da66-46f2-9c73-6d40d53cb1e9 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-c4cc3282-5d5f-4de2-8931-853e4c13aa60-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-0e7c82cd-d54f-496f-b111-b9a3ed9c981a-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-0e7c82cd-d54f-496f-b111-b9a3ed9c981a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:43 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0" returned: 0 in 0.687s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456b16ff-9407-4070-9d7b-cdb984ca705b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3237ea67-c727-4041-b855-418f37f83a2f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-quobyte-0e7c82cd-d54f-496f-b111-b9a3ed9c981a" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-0e7c82cd-d54f-496f-b111-b9a3ed9c981a" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2505114-dc7e-4e6c-944d-4b456da87578]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:43 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b Apr 24 01:12:43 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:43 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a Apr 24 01:12:43 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:44 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-6d781e8b-7125-4bcb-8cbe-7618309c0801 tempest-VolumesTransfersV355Test-1283006259 None] Transfer volume completed successfully. Apr 24 01:12:44 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b" returned: 0 in 0.750s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:44 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 Apr 24 01:12:44 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:44 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a" returned: 0 in 0.824s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:44 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a Apr 24 01:12:44 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:44 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0" returned: 0 in 0.643s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:44 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0 Apr 24 01:12:44 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:44 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0e7c82cd-d54f-496f-b111-b9a3ed9c981a" returned: 0 in 0.578s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-0e7c82cd-d54f-496f-b111-b9a3ed9c981a" released by "delete_volume" :: held 1.445s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created reservations ['bd1e0355-3143-4641-9818-45c45d193ef7', 'b758db28-2f85-4e27-aa49-e83e728074cf', 'b0a27321-308e-4082-ad44-dd094a747190', '8103eb82-a05e-4b5d-bf53-739030893436'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Acquiring lock "cinder-ab1b4923-db72-4ea0-a330-f7d103fd786d-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Lock "cinder-ab1b4923-db72-4ea0-a330-f7d103fd786d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Acquiring lock "cinder-quobyte-ab1b4923-db72-4ea0-a330-f7d103fd786d" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:45 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:45 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Lock "cinder-quobyte-ab1b4923-db72-4ea0-a330-f7d103fd786d" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e6472-f15a-475b-961d-4a00ad5dbc64]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:45 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d Apr 24 01:12:45 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:45 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b.57930566-05e8-4154-a562-8bac535be1a0" returned: 0 in 0.545s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-57930566-05e8-4154-a562-8bac535be1a0" released by "_delete_snapshot" :: held 2.787s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-456b16ff-9407-4070-9d7b-cdb984ca705b" released by "delete_snapshot" :: held 2.816s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:45 devstack cinder-volume[81925]: WARNING cinder.quota [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-208444389 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-208444389, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:12:45 devstack cinder-volume[81925]: WARNING cinder.quota [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-208444389 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-208444389, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] Created reservations ['268353ea-7cbd-4534-8707-96b57cbd3182', '5e988c5c-2529-435c-8446-45aacb4693f7', 'f4803bea-d1de-4c83-8128-479603f8b90f', '3c9d1242-09f2-46ce-81cf-9d5d32d5d89a'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:45 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f117489f-f058-4a4f-9abc-87dbe0c7dcde tempest-GroupSnapshotsTest-672102948 None] group_snapshot 592f6739-0cfa-438c-865e-97259e2c9448: deleted successfully Apr 24 01:12:45 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.510s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:45 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Deleted volume successfully. Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-42d93f00-721b-4975-ae96-4436ee705e27 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-0e7c82cd-d54f-496f-b111-b9a3ed9c981a-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-quobyte-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc18b97f-e2e3-4b95-a366-35b1690994be]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:45 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d" returned: 0 in 0.644s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:45 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d Apr 24 01:12:45 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:45 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 Apr 24 01:12:45 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "cinder-quobyte-456b16ff-9407-4070-9d7b-cdb984ca705b" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-456b16ff-9407-4070-9d7b-cdb984ca705b" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f64044-02df-454c-985a-084e96bb98f7]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:46 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab1b4923-db72-4ea0-a330-f7d103fd786d" returned: 0 in 0.562s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:46 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b Apr 24 01:12:46 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Lock "cinder-quobyte-ab1b4923-db72-4ea0-a330-f7d103fd786d" released by "delete_volume" :: held 1.246s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Created reservations ['fc774a31-ebff-4a7c-93d8-8e874fb92069', 'd157c0eb-3ae3-468f-aae2-e744b421e437', '8af7bde1-5d83-454c-b096-1f3344cb80b0', 'a0acd69f-40ed-445a-ae00-c4331ca7af8b'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:46 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:46 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:46 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767" returned: 0 in 0.785s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:46 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767 Apr 24 01:12:46 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:47 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b" returned: 0 in 0.615s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:47 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b Apr 24 01:12:47 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:47 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.503s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Deleted volume successfully. Apr 24 01:12:47 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-65b4cc73-24c8-4413-89c7-d60019cf4fb2 tempest-VolumesTransfersV355Test-995572065 None] Lock "cinder-ab1b4923-db72-4ea0-a330-f7d103fd786d-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767" released by "delete_volume" :: held 1.350s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created reservations ['1120cdf5-c6a4-49f2-959c-34285bda67c9', '27c2c900-9b4f-417f-8d5b-81e8927e5475', '04e82783-3bd8-44de-b03c-0aeb65e279bf', 'defa2fb5-60c6-4f49-908d-e124618dfa4d'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:47 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:47 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:47 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-456b16ff-9407-4070-9d7b-cdb984ca705b" returned: 0 in 0.600s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Lock "cinder-quobyte-456b16ff-9407-4070-9d7b-cdb984ca705b" released by "delete_volume" :: held 1.281s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Created reservations ['cfa0d72b-1c7a-46f1-a077-f91da762f6d3'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:47 devstack cinder-volume[81925]: WARNING cinder.quota [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-208444389 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-208444389, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Created reservations ['fdc5da70-1108-4cc4-8edf-dbeedbdc58a2', '482713e8-6e07-4f0f-98aa-80ef083dbc4a', 'a92daa5a-f2a6-451c-86e7-d11b2ab6fb6b', '26744f2f-4497-4f94-b2b5-e366e4a52b8f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:47 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.588s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Deleted volume successfully. Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Flow 'volume_create_manager' (3e4d3c1a-b5a7-46f5-afbc-79150c57217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cff880-cac4-4466-bf3b-a7a84c41c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cff880-cac4-4466-bf3b-a7a84c41c67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1389693636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a93c312-b372-4f6e-be57-ca05419e48e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85513db39e6b4bb9a1654048dd80461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:48Z,use_quota=True,user_id='35f9f7d56f74449dbc66c2423ac1334f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289eb8f9-b3ef-4c8a-aa8e-09d97c353544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289eb8f9-b3ef-4c8a-aa8e-09d97c353544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53a4ecd-f4a7-4e0e-b787-1d1a3f00634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53a4ecd-f4a7-4e0e-b787-1d1a3f00634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a93c312-b372-4f6e-be57-ca05419e48e2', 'volume_name': 'volume-9a93c312-b372-4f6e-be57-ca05419e48e2', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8fcde3-8093-4095-98c4-6aabe47463c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8fcde3-8093-4095-98c4-6aabe47463c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658268ae-3245-4094-a54b-79ca754d47c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:48 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Volume 9a93c312-b372-4f6e-be57-ca05419e48e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a93c312-b372-4f6e-be57-ca05419e48e2', 'volume_size': 1} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1389693636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a93c312-b372-4f6e-be57-ca05419e48e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85513db39e6b4bb9a1654048dd80461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:48Z,use_quota=True,user_id='35f9f7d56f74449dbc66c2423ac1334f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Creating volume 9a93c312-b372-4f6e-be57-ca05419e48e2 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:48 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:48 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 1073741824 Apr 24 01:12:48 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-734b5d10-d998-4498-b2b8-1f45ca0fe3a5-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-da37ce04-38ba-4367-8da4-0aaca839cfff tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-eb4d8e9e-aaa5-48a7-8aee-64b2657ea767-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:48 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:48 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-734b5d10-d998-4498-b2b8-1f45ca0fe3a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-quobyte-407ce2a8-f32f-468c-8bc9-93835c35edaa" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-407ce2a8-f32f-468c-8bc9-93835c35edaa" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-quobyte-734b5d10-d998-4498-b2b8-1f45ca0fe3a5" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-734b5d10-d998-4498-b2b8-1f45ca0fe3a5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Deleting offline snapshot 734b5d10-d998-4498-b2b8-1f45ca0fe3a5 of volume 407ce2a8-f32f-468c-8bc9-93835c35edaa {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] snapshot_file for this snap is: volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d49f82f-b559-4594-aad5-98e3fd5a22d8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:48 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 Apr 24 01:12:48 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:48 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.618s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-cef91ef9-764b-4701-8e4a-aa0d2932c143 tempest-GroupSnapshotsTest-672102948 None] Delete group completed successfully. Apr 24 01:12:48 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 1073741824" returned: 0 in 0.837s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:48 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5" returned: 0 in 0.730s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-407ce2a8-f32f-468c-8bc9-93835c35edaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:12:48 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 Apr 24 01:12:48 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f28cb17-aba2-40cd-923c-0957e0f16c13]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:49 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa Apr 24 01:12:49 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:49 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2" returned: 0 in 0.551s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658268ae-3245-4094-a54b-79ca754d47c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a93c312-b372-4f6e-be57-ca05419e48e2', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02fd3bf-dc7e-4942-be58-1f828c6bb78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:49 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Volume volume-9a93c312-b372-4f6e-be57-ca05419e48e2 (9a93c312-b372-4f6e-be57-ca05419e48e2): created successfully Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02fd3bf-dc7e-4942-be58-1f828c6bb78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Flow 'volume_create_manager' (3e4d3c1a-b5a7-46f5-afbc-79150c57217e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:49 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-de1c89ac-3970-4f7f-8822-5e02318ef576 tempest-VolumesTransfersV355Test-1499264264 None] Created volume successfully. Apr 24 01:12:49 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa" returned: 0 in 0.846s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:49 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 Apr 24 01:12:49 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Acquiring lock "cinder-9a93c312-b372-4f6e-be57-ca05419e48e2-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Lock "cinder-9a93c312-b372-4f6e-be57-ca05419e48e2-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Acquiring lock "cinder-quobyte-9a93c312-b372-4f6e-be57-ca05419e48e2" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Lock "cinder-quobyte-9a93c312-b372-4f6e-be57-ca05419e48e2" acquired by "delete_volume" :: waited 0.035s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:50 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb20073-fd06-491f-b1d9-16938ceecc3d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:51 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5" returned: 0 in 1.272s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:51 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 Apr 24 01:12:51 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5 Apr 24 01:12:51 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:51 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:51 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa.734b5d10-d998-4498-b2b8-1f45ca0fe3a5" returned: 0 in 0.662s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:51 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2" returned: 0 in 0.814s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-734b5d10-d998-4498-b2b8-1f45ca0fe3a5" released by "_delete_snapshot" :: held 3.645s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-407ce2a8-f32f-468c-8bc9-93835c35edaa" released by "delete_snapshot" :: held 3.688s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:51 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2 Apr 24 01:12:51 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:51 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created reservations ['2b4bd5a0-d263-49ec-a383-1bd96fec4714', 'b72acca6-f641-4387-9ced-ba8a407c0305', '268fb2b8-e681-47f9-8cbb-6a6eaad24926', '81ac130e-0570-42ff-b3ef-b98b0446fcf1'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:52 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Delete snapshot completed successfully. Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cfe4f626-aabf-46e0-ae6a-af7392784a89 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-734b5d10-d998-4498-b2b8-1f45ca0fe3a5-delete_snapshot" released by "delete_snapshot" :: held 3.947s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-407ce2a8-f32f-468c-8bc9-93835c35edaa-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-407ce2a8-f32f-468c-8bc9-93835c35edaa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:52 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9a93c312-b372-4f6e-be57-ca05419e48e2" returned: 0 in 0.711s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Lock "cinder-quobyte-9a93c312-b372-4f6e-be57-ca05419e48e2" released by "delete_volume" :: held 1.573s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "cinder-quobyte-407ce2a8-f32f-468c-8bc9-93835c35edaa" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-407ce2a8-f32f-468c-8bc9-93835c35edaa" acquired by "delete_volume" :: waited 0.032s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e50547-b059-42b2-a944-04b7323c6589]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Created reservations ['79da3559-b981-45e3-baf5-2e181e4a198a', '95b95c29-bb07-48a7-94ed-6e9c9f000e93', 'cc7fa0bc-0e08-4d9a-8e0f-89635cdd68ac', '23d7a0f7-cd61-4cda-b248-a4bdedde07fc'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:52 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa Apr 24 01:12:52 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:52 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:52 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:53 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-a157a2c7-ed4e-4e4d-92c4-d2583236bf66 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Terminate volume connection completed successfully. Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-a157a2c7-ed4e-4e4d-92c4-d2583236bf66 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Deleting attachment b60489c8-dc14-49b2-8c96-ab0088d341aa. {{(pid=81925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 01:12:53 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa" returned: 0 in 0.609s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:53 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa Apr 24 01:12:53 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:53 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.627s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:53 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Deleted volume successfully. Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-70ab45b0-ac14-4528-b0e9-12e38e0ab3c8 tempest-VolumesTransfersV355Test-995572065 None] Lock "cinder-9a93c312-b372-4f6e-be57-ca05419e48e2-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "cinder-e834477d-c542-4dbd-a2fd-80b41cc99664-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "cinder-e834477d-c542-4dbd-a2fd-80b41cc99664-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "cinder-quobyte-e834477d-c542-4dbd-a2fd-80b41cc99664" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "cinder-quobyte-e834477d-c542-4dbd-a2fd-80b41cc99664" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1287b01e-3281-47b5-98b1-3f591153c25b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:53 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-407ce2a8-f32f-468c-8bc9-93835c35edaa" returned: 0 in 0.740s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-quobyte-407ce2a8-f32f-468c-8bc9-93835c35edaa" released by "delete_volume" :: held 1.425s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:54 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 Apr 24 01:12:54 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Created reservations ['498d7cc3-0770-482b-b3ca-99e5047fff7d', '847f0e0c-b625-421c-8e02-f96bf090180a', '063f68dc-7121-44ec-a0dc-b9325f11f197', '6682cedd-c4a6-4333-b26e-7584edd80d40'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:54 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:54 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:54 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664" returned: 0 in 0.726s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:54 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664 Apr 24 01:12:54 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:54 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.700s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:54 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Deleted volume successfully. Apr 24 01:12:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d5c5fea1-a6be-413e-b661-2b8c2a445369 tempest-CreateVolumesFromSnapshotTest-1874967122 None] Lock "cinder-407ce2a8-f32f-468c-8bc9-93835c35edaa-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5e617811-4a00-48fc-a699-093f26708f33 tempest-GroupsTest-518410138 None] Group tempest-Group1-100240022: creating Apr 24 01:12:55 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e834477d-c542-4dbd-a2fd-80b41cc99664" returned: 0 in 0.784s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "cinder-quobyte-e834477d-c542-4dbd-a2fd-80b41cc99664" released by "delete_volume" :: held 1.574s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5e617811-4a00-48fc-a699-093f26708f33 tempest-GroupsTest-518410138 None] Group tempest-Group1-100240022: created successfully Apr 24 01:12:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5e617811-4a00-48fc-a699-093f26708f33 tempest-GroupsTest-518410138 None] Create group completed successfully. Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG cinder.quota [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Created reservations ['f57c5389-fc16-4b76-a7d7-5470e38d46c6', 'a3fef003-5d51-43c3-91cd-78f1b962ea92', 'f07e33b7-c8c7-4006-aff7-4921f19ba927', 'fadc9fb2-b67e-476a-bf36-3c1c09ef6171'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:55 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:12:55 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:56 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.691s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:56 devstack cinder-volume[81925]: DEBUG cinder.manager [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:12:56 devstack cinder-volume[81925]: INFO cinder.volume.manager [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Deleted volume successfully. Apr 24 01:12:56 devstack cinder-volume[81925]: DEBUG cinder.coordination [req-ea8869b5-b94f-4c55-9851-a27843004cb2 req-85446b7e-8885-4734-b1bb-5736df91df09 tempest-ServerBootFromVolumeStableRescueTest-1346506278 None] Lock "cinder-e834477d-c542-4dbd-a2fd-80b41cc99664-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:12:56 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e22505db-e04a-44b6-841c-134f55a6e5b5 tempest-GroupsTest-518410138 None] Group tempest-Group2-40689796: creating Apr 24 01:12:56 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e22505db-e04a-44b6-841c-134f55a6e5b5 tempest-GroupsTest-518410138 None] Group tempest-Group2-40689796: created successfully Apr 24 01:12:56 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e22505db-e04a-44b6-841c-134f55a6e5b5 tempest-GroupsTest-518410138 None] Create group completed successfully. Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Flow 'volume_create_manager' (f736087f-2104-47e7-95bc-076f372e74bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4f7a94-a08a-4390-b01c-73a19516d9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4f7a94-a08a-4390-b01c-73a19516d9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-667423854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e438253-0d09-4bf2-ad0d-16a8a35af2fc,host='devstack@QuobyteHD#QuobyteHD',id=0f495499-00a5-4e05-ba06-195dc35e20a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26cbb074f9c24ef28df9dca786dd609c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:58Z,use_quota=True,user_id='2d3322478af0412ba1770a4454d3a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b990c8-2d69-496e-a6b1-d7bb99162734),volume_type_id=c0b990c8-2d69-496e-a6b1-d7bb99162734)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9688038b-014d-4abc-b660-e79ab0caef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9688038b-014d-4abc-b660-e79ab0caef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dfb9ff-78b2-41f9-beee-8f40d9a6bcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dfb9ff-78b2-41f9-beee-8f40d9a6bcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f495499-00a5-4e05-ba06-195dc35e20a3', 'volume_name': 'volume-0f495499-00a5-4e05-ba06-195dc35e20a3', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40baa0e3-b3c5-4e00-a7ca-063799e8b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40baa0e3-b3c5-4e00-a7ca-063799e8b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d07ca7-8467-457b-b87b-33b3230c0843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Volume 0f495499-00a5-4e05-ba06-195dc35e20a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f495499-00a5-4e05-ba06-195dc35e20a3', 'volume_size': 1} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e438253-0d09-4bf2-ad0d-16a8a35af2fc,created_at=2026-04-23T23:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-667423854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e438253-0d09-4bf2-ad0d-16a8a35af2fc,host='devstack@QuobyteHD#QuobyteHD',id=0f495499-00a5-4e05-ba06-195dc35e20a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26cbb074f9c24ef28df9dca786dd609c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:58Z,use_quota=True,user_id='2d3322478af0412ba1770a4454d3a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b990c8-2d69-496e-a6b1-d7bb99162734),volume_type_id=c0b990c8-2d69-496e-a6b1-d7bb99162734)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Creating volume 0f495499-00a5-4e05-ba06-195dc35e20a3 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:58 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:58 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 1073741824 Apr 24 01:12:58 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Flow 'volume_create_manager' (eb9be4f2-c5a8-4326-9985-49b9fadc3b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5260a75a-2fae-46ad-a23d-0eb24b8b0875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5260a75a-2fae-46ad-a23d-0eb24b8b0875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1473097216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342eed7e-f3f1-40e6-a99b-899435586b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71676b1bafff4e1cb33835487c4af368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:59Z,use_quota=True,user_id='b2467187db00499ea6c302ce81e1584a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75efaaa3-53bc-414b-8a59-ba125194774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75efaaa3-53bc-414b-8a59-ba125194774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bf45f0-ef35-4ac3-89de-bea8920ef8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bf45f0-ef35-4ac3-89de-bea8920ef8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342eed7e-f3f1-40e6-a99b-899435586b22', 'volume_name': 'volume-342eed7e-f3f1-40e6-a99b-899435586b22', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8d14ef-4569-4eab-98ba-f778deed1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8d14ef-4569-4eab-98ba-f778deed1039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4f36de-4df6-4e78-b71b-205e70c59c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:58 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Volume 342eed7e-f3f1-40e6-a99b-899435586b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342eed7e-f3f1-40e6-a99b-899435586b22', 'volume_size': 1} Apr 24 01:12:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:59 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 1073741824" returned: 0 in 1.016s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:59 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 Apr 24 01:12:59 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:59 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3" returned: 0 in 0.536s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1473097216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342eed7e-f3f1-40e6-a99b-899435586b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71676b1bafff4e1cb33835487c4af368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:12:59Z,use_quota=True,user_id='b2467187db00499ea6c302ce81e1584a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Creating volume 342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:12:59 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:12:59 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 1073741824 Apr 24 01:12:59 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d07ca7-8467-457b-b87b-33b3230c0843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f495499-00a5-4e05-ba06-195dc35e20a3', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03dc988-8131-4e75-be0a-c073f7fa1774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:12:59 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Volume volume-0f495499-00a5-4e05-ba06-195dc35e20a3 (0f495499-00a5-4e05-ba06-195dc35e20a3): created successfully Apr 24 01:12:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03dc988-8131-4e75-be0a-c073f7fa1774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Flow 'volume_create_manager' (f736087f-2104-47e7-95bc-076f372e74bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (cd45e056-faa2-4a04-a554-79f4f83b8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1327adce-8282-4ec5-9d48-8d2c2b4b5300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:00 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e16712e0-c505-4bc3-859e-99b0d95ece19 tempest-GroupsTest-518410138 None] Created volume successfully. Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1327adce-8282-4ec5-9d48-8d2c2b4b5300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-914054510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beebf5eb-3639-47d6-ad83-d258875e680c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:00Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbead11-8337-4cf5-8bbd-a8ec4d242598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbead11-8337-4cf5-8bbd-a8ec4d242598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecb3e4a-46c4-4f52-a394-4c52f2887e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecb3e4a-46c4-4f52-a394-4c52f2887e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beebf5eb-3639-47d6-ad83-d258875e680c', 'volume_name': 'volume-beebf5eb-3639-47d6-ad83-d258875e680c', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfec30e0-677c-488e-ace5-4fa4bfb8a649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfec30e0-677c-488e-ace5-4fa4bfb8a649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e45f23-7338-45ac-977a-6764f9f78ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:00 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Volume beebf5eb-3639-47d6-ad83-d258875e680c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beebf5eb-3639-47d6-ad83-d258875e680c', 'volume_size': 1} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:00 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 1073741824" returned: 0 in 0.675s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:00 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 Apr 24 01:13:00 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Acquiring lock "cinder-quobyte-0f495499-00a5-4e05-ba06-195dc35e20a3" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Lock "cinder-quobyte-0f495499-00a5-4e05-ba06-195dc35e20a3" acquired by "delete_volume" :: waited 0.037s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[921bb69b-946e-45ba-a200-df42383f21a8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:01 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 Apr 24 01:13:01 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:01 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22" returned: 0 in 0.592s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-914054510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beebf5eb-3639-47d6-ad83-d258875e680c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:00Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Creating volume beebf5eb-3639-47d6-ad83-d258875e680c {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:13:01 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:01 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c 1073741824 Apr 24 01:13:01 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4f36de-4df6-4e78-b71b-205e70c59c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342eed7e-f3f1-40e6-a99b-899435586b22', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d898f8-3b4a-4e40-83e4-c95a0a6caaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:01 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Volume volume-342eed7e-f3f1-40e6-a99b-899435586b22 (342eed7e-f3f1-40e6-a99b-899435586b22): created successfully Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d898f8-3b4a-4e40-83e4-c95a0a6caaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Flow 'volume_create_manager' (eb9be4f2-c5a8-4326-9985-49b9fadc3b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:01 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-be399c03-18b8-4ec5-b64a-1f1edec2fc0d tempest-VolumeDependencyTests-1522854737 None] Created volume successfully. Apr 24 01:13:01 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3" returned: 0 in 0.595s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:01 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3 Apr 24 01:13:01 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:01 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c 1073741824" returned: 0 in 0.643s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:01 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c Apr 24 01:13:01 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:02 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0f495499-00a5-4e05-ba06-195dc35e20a3" returned: 0 in 0.561s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Lock "cinder-quobyte-0f495499-00a5-4e05-ba06-195dc35e20a3" released by "delete_volume" :: held 1.220s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Created reservations ['3658ed22-8ce8-4e76-9c13-f7e42344b35f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:02 devstack cinder-volume[81925]: WARNING cinder.quota [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2085802148 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2085802148, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:13:02 devstack cinder-volume[81925]: WARNING cinder.quota [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2085802148 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2085802148, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Created reservations ['77b76e16-a75d-4816-96c6-10b798e386b6', 'aa847103-0b7a-4ab3-8165-77d8cd38b31e', '38df9dbd-90e1-4333-931e-6afcada9c54d', 'e36c564f-bead-423f-81a2-9a3100bdebaf'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:02 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:02 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:02 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c" returned: 0 in 0.650s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.494s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Creating offline snapshot 6d2757af-0db1-4869-bf56-09eaf0c0b6d5 of volume 342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e45f23-7338-45ac-977a-6764f9f78ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beebf5eb-3639-47d6-ad83-d258875e680c', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bee9bf1-815a-45cf-bcc5-0df95f537c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[794dff1e-40c8-41b5-a563-bd740903c743]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:02 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Volume volume-beebf5eb-3639-47d6-ad83-d258875e680c (beebf5eb-3639-47d6-ad83-d258875e680c): created successfully Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bee9bf1-815a-45cf-bcc5-0df95f537c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (cd45e056-faa2-4a04-a554-79f4f83b8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:02 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b78aee9b-79ae-4f1f-ab59-d0f2e301ade0 tempest-VolumesGetTest-1436487431 None] Created volume successfully. Apr 24 01:13:02 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 Apr 24 01:13:02 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:02 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.474s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:02 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:02 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-db641d57-f610-405d-bd16-5e90346fc692 tempest-GroupsTest-518410138 None] Delete group completed successfully. Apr 24 01:13:03 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22" returned: 0 in 0.572s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:03 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 1G Apr 24 01:13:03 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Created reservations ['a1577fb2-89cc-4226-846c-b8c117658eb3'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:03 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:03 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (2ca5b336-de3d-45c7-bab3-0a1fb3fd3603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3933e4a1-4b21-4655-95e8-b9be3225aaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3933e4a1-4b21-4655-95e8-b9be3225aaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1963435614',display_name='tempest-VolumesGetTest-Volume-987144710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a56f32-31c5-460b-b11a-ba98bd4bb2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:04Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026d6715-8161-4790-8a3a-aaaf6ffe69f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026d6715-8161-4790-8a3a-aaaf6ffe69f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e3fba9-b8b1-410b-8b5e-f3cdf14ebb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e3fba9-b8b1-410b-8b5e-f3cdf14ebb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a56f32-31c5-460b-b11a-ba98bd4bb2dd', 'volume_name': 'volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5449fbc1-9108-4a35-bdcb-91a6cbe82c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5449fbc1-9108-4a35-bdcb-91a6cbe82c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfcc4c8-39ce-49dc-b578-be255a026a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:03 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Volume 19a56f32-31c5-460b-b11a-ba98bd4bb2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd', 'volume_size': 1} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:03 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 1G" returned: 0 in 0.754s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342eed7e-f3f1-40e6-a99b-899435586b22 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:03 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342eed7e-f3f1-40e6-a99b-899435586b22 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 Apr 24 01:13:03 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:04 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.519s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:04 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:04 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a5785a02-a7c5-48ff-bd1e-de68b6f03e2c tempest-GroupsTest-518410138 None] Delete group completed successfully. Apr 24 01:13:04 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342eed7e-f3f1-40e6-a99b-899435586b22 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5" returned: 0 in 0.514s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:04 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 is being set with open permissions: ugo+rw Apr 24 01:13:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:04 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 Apr 24 01:13:04 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:04 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5" returned: 0 in 0.492s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:04 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-71c0955f-3241-4d3f-ac8f-a3605b6e2f07 tempest-GroupsTest-518410138 None] Group tempest-GroupsTest-Group-103683701: creating Apr 24 01:13:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:05 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-71c0955f-3241-4d3f-ac8f-a3605b6e2f07 tempest-GroupsTest-518410138 None] Group tempest-GroupsTest-Group-103683701: created successfully Apr 24 01:13:05 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.info Apr 24 01:13:05 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:05 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-71c0955f-3241-4d3f-ac8f-a3605b6e2f07 tempest-GroupsTest-518410138 None] Create group completed successfully. Apr 24 01:13:05 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.info" returned: 0 in 0.441s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:05 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.info is being set with open permissions: ugo+rw Apr 24 01:13:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:05 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.info Apr 24 01:13:05 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:05 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.info" returned: 0 in 0.530s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.415s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1963435614',display_name='tempest-VolumesGetTest-Volume-987144710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a56f32-31c5-460b-b11a-ba98bd4bb2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:04Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Creating volume 19a56f32-31c5-460b-b11a-ba98bd4bb2dd {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:13:06 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:06 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd 1073741824 Apr 24 01:13:06 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-bf939559-0966-49ca-9f1b-67d925f73e36 tempest-VolumeDependencyTests-1522854737 None] Create snapshot completed successfully Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Flow 'volume_create_manager' (33009d17-b9d3-449c-80fc-84945b4f924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad45f676-ab69-4851-b9bf-1a38fb9f342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad45f676-ab69-4851-b9bf-1a38fb9f342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1422861059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2fc080b-83f4-44c5-9122-1aa1cbad567d,host='devstack@QuobyteHD#QuobyteHD',id=87e4fdce-732e-4c15-b3f8-7d756295378b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26cbb074f9c24ef28df9dca786dd609c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:07Z,use_quota=True,user_id='2d3322478af0412ba1770a4454d3a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb2ac26a-992f-4d2c-a2f8-f978381c1230),volume_type_id=bb2ac26a-992f-4d2c-a2f8-f978381c1230)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffa4f38-3333-432b-a288-41d6ade7fae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffa4f38-3333-432b-a288-41d6ade7fae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca7610f-0876-4682-98be-ac52f86939fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca7610f-0876-4682-98be-ac52f86939fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e4fdce-732e-4c15-b3f8-7d756295378b', 'volume_name': 'volume-87e4fdce-732e-4c15-b3f8-7d756295378b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f501f19a-e201-4ede-8542-65077b880a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f501f19a-e201-4ede-8542-65077b880a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edbc27b-773b-4d3f-80c4-df8c768beb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Volume 87e4fdce-732e-4c15-b3f8-7d756295378b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e4fdce-732e-4c15-b3f8-7d756295378b', 'volume_size': 1} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Flow 'volume_create_manager' (da09bcf9-587d-4d1f-beb9-5a8a7dc4de37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a492436-0361-44e0-8672-8e6e11f36839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a492436-0361-44e0-8672-8e6e11f36839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-821436853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1a5b29-330c-4a4c-a870-408a14d030f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71676b1bafff4e1cb33835487c4af368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d2757af-0db1-4869-bf56-09eaf0c0b6d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:07Z,use_quota=True,user_id='b2467187db00499ea6c302ce81e1584a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9888ba-16d1-49c6-b657-a69b3ac006f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9888ba-16d1-49c6-b657-a69b3ac006f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2238ebcf-bff0-4486-a239-14cb144874f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2238ebcf-bff0-4486-a239-14cb144874f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb1a5b29-330c-4a4c-a870-408a14d030f1', 'volume_name': 'volume-fb1a5b29-330c-4a4c-a870-408a14d030f1', 'volume_size': 1, 'snapshot_id': '6d2757af-0db1-4869-bf56-09eaf0c0b6d5'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fb09d9-db17-454c-add7-4ba4ced567cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fb09d9-db17-454c-add7-4ba4ced567cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f9b7cd-3588-4913-8a8c-bdd9d4902773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:06 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Volume fb1a5b29-330c-4a4c-a870-408a14d030f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb1a5b29-330c-4a4c-a870-408a14d030f1', 'volume_size': 1, 'snapshot_id': '6d2757af-0db1-4869-bf56-09eaf0c0b6d5'} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd 1073741824" returned: 0 in 0.939s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:07 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd Apr 24 01:13:07 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:07 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd" returned: 0 in 0.449s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a2fc080b-83f4-44c5-9122-1aa1cbad567d,created_at=2026-04-23T23:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1422861059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2fc080b-83f4-44c5-9122-1aa1cbad567d,host='devstack@QuobyteHD#QuobyteHD',id=87e4fdce-732e-4c15-b3f8-7d756295378b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26cbb074f9c24ef28df9dca786dd609c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:07Z,use_quota=True,user_id='2d3322478af0412ba1770a4454d3a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb2ac26a-992f-4d2c-a2f8-f978381c1230),volume_type_id=bb2ac26a-992f-4d2c-a2f8-f978381c1230)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Creating volume 87e4fdce-732e-4c15-b3f8-7d756295378b {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:13:07 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfcc4c8-39ce-49dc-b578-be255a026a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:07 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b 1073741824 Apr 24 01:13:07 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1600404-ed4f-40fe-b7a5-6e478c63cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:07 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Volume volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd (19a56f32-31c5-460b-b11a-ba98bd4bb2dd): created successfully Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1600404-ed4f-40fe-b7a5-6e478c63cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:07 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (2ca5b336-de3d-45c7-bab3-0a1fb3fd3603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:07 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-817f1345-f08e-4eb1-9037-6cef8a760ac6 tempest-VolumesGetTest-1436487431 None] Created volume successfully. Apr 24 01:13:08 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b 1073741824" returned: 0 in 0.838s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-19a56f32-31c5-460b-b11a-ba98bd4bb2dd-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:08 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b Apr 24 01:13:08 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Lock "cinder-19a56f32-31c5-460b-b11a-ba98bd4bb2dd-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-19a56f32-31c5-460b-b11a-ba98bd4bb2dd" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-19a56f32-31c5-460b-b11a-ba98bd4bb2dd" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:08 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e2086d-1d70-4d16-9d2f-1876515a5e80]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:08 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd Apr 24 01:13:08 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:09 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b" returned: 0 in 0.618s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.051s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-6d2757af-0db1-4869-bf56-09eaf0c0b6d5-fb1a5b29-330c-4a4c-a870-408a14d030f1" by "_create_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edbc27b-773b-4d3f-80c4-df8c768beb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e4fdce-732e-4c15-b3f8-7d756295378b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62051636-4cef-44fa-b8ae-b7d77df6e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-6d2757af-0db1-4869-bf56-09eaf0c0b6d5-fb1a5b29-330c-4a4c-a870-408a14d030f1" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Creating volume fb1a5b29-330c-4a4c-a870-408a14d030f1 from snapshot 6d2757af-0db1-4869-bf56-09eaf0c0b6d5 {{(pid=81925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-fb1a5b29-330c-4a4c-a870-408a14d030f1" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:09 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Volume volume-87e4fdce-732e-4c15-b3f8-7d756295378b (87e4fdce-732e-4c15-b3f8-7d756295378b): created successfully Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62051636-4cef-44fa-b8ae-b7d77df6e53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Flow 'volume_create_manager' (33009d17-b9d3-449c-80fc-84945b4f924c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-fb1a5b29-330c-4a4c-a870-408a14d030f1" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] snapshot: 6d2757af-0db1-4869-bf56-09eaf0c0b6d5, volume: fb1a5b29-330c-4a4c-a870-408a14d030f1, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:09 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-22f9154b-54ec-4083-8ba9-a085181e692a tempest-GroupsTest-518410138 None] Created volume successfully. Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[99beb86a-526e-4332-b699-b58577552614]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:09 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd" returned: 0 in 0.721s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:09 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd Apr 24 01:13:09 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:09 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 Apr 24 01:13:09 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:09 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-19a56f32-31c5-460b-b11a-ba98bd4bb2dd" returned: 0 in 0.586s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-19a56f32-31c5-460b-b11a-ba98bd4bb2dd" released by "delete_volume" :: held 1.365s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:09 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5" returned: 0 in 0.718s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-342eed7e-f3f1-40e6-a99b-899435586b22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb780f-e8d6-4636-95e8-7ee84be15fa0]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:09 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Created reservations ['772829dc-d12f-4da4-aeb7-b74d56c84185', '54dc5381-fc77-4fae-a9ce-24d940e7cb04', 'c88e03ab-ad67-432c-88d7-1530a0c49f2d', '2f013f5e-2f2d-482f-abd6-fad31f7fe2cc'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:10 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 Apr 24 01:13:10 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:10 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:10 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Flow 'volume_create_manager' (fa5fa604-13dc-48df-923c-94f65ad546a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a10630-6e0a-4e26-9b62-d9ecbfbcdd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a10630-6e0a-4e26-9b62-d9ecbfbcdd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1344169215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2fc080b-83f4-44c5-9122-1aa1cbad567d,host='devstack@QuobyteHD#QuobyteHD',id=af0d9313-fab8-4ea9-934b-6f0b08981a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26cbb074f9c24ef28df9dca786dd609c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:10Z,use_quota=True,user_id='2d3322478af0412ba1770a4454d3a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb2ac26a-992f-4d2c-a2f8-f978381c1230),volume_type_id=bb2ac26a-992f-4d2c-a2f8-f978381c1230)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0619b96-5deb-4c56-abcb-d5c6cdc6a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0619b96-5deb-4c56-abcb-d5c6cdc6a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057e0c77-508c-4d5f-9c85-c67b9a35b652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057e0c77-508c-4d5f-9c85-c67b9a35b652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0d9313-fab8-4ea9-934b-6f0b08981a6b', 'volume_name': 'volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61d05cc-dfb6-4774-b7b9-c623ade89095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61d05cc-dfb6-4774-b7b9-c623ade89095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f9ab90-437a-41d5-9b91-7b330fa5ed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:10 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Volume af0d9313-fab8-4ea9-934b-6f0b08981a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b', 'volume_size': 1} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:10 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.624s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:10 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Deleted volume successfully. Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a1ac6f57-d51c-4571-b48c-0571f52d6aa2 tempest-VolumesGetTest-1436487431 None] Lock "cinder-19a56f32-31c5-460b-b11a-ba98bd4bb2dd-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:10 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22" returned: 0 in 0.847s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-beebf5eb-3639-47d6-ad83-d258875e680c-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:10 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 Apr 24 01:13:10 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Lock "cinder-beebf5eb-3639-47d6-ad83-d258875e680c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-beebf5eb-3639-47d6-ad83-d258875e680c" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-beebf5eb-3639-47d6-ad83-d258875e680c" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[666dd01c-d0e2-4f18-bb45-2f6bbdd80b48]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:10 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c Apr 24 01:13:10 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:11 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c" returned: 0 in 0.935s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:11 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c Apr 24 01:13:11 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:11 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:11 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:13 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.283s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:13 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-beebf5eb-3639-47d6-ad83-d258875e680c" returned: 0 in 1.708s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-beebf5eb-3639-47d6-ad83-d258875e680c" released by "delete_volume" :: held 2.694s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Created reservations ['21195f03-d8a5-472b-b83a-7790d92df77f', 'af0b423c-450f-4e18-bdf8-2e08e8b7629e', 'effe74ee-1da9-4117-b2f0-505dbd6a6a34', 'f94a61a0-993e-4f63-9bb2-998b626182ed'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:14 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:14 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (f91d2a48-aa31-48e7-b86c-79b929654b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d863d48-a987-4686-aad6-7553389ce03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d863d48-a987-4686-aad6-7553389ce03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2022824326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c68ee62-42bc-4930-8755-e19b3e62cbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:15Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3ccc01-f31b-44de-8a88-45c3f15eac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3ccc01-f31b-44de-8a88-45c3f15eac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ca22ba-f5de-4abe-8810-14c09acd8524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ca22ba-f5de-4abe-8810-14c09acd8524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c68ee62-42bc-4930-8755-e19b3e62cbe2', 'volume_name': 'volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a041ae43-7343-47cf-892b-a726bc2cc7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a041ae43-7343-47cf-892b-a726bc2cc7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2392206a-e271-42cc-8d74-0fb7bb051291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:15 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Volume 3c68ee62-42bc-4930-8755-e19b3e62cbe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2', 'volume_size': 1} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:15 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.645s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:15 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Deleted volume successfully. Apr 24 01:13:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6cc6e858-7933-4800-943e-ce94e2b3e704 tempest-VolumesGetTest-1436487431 None] Lock "cinder-beebf5eb-3639-47d6-ad83-d258875e680c-delete_volume" released by "delete_volume" :: held 4.857s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:16 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1" returned: 0 in 6.147s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:16 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea99732-e1f6-4e60-9394-f740a3c2818f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:17 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 Apr 24 01:13:17 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:17 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22" returned: 0 in 0.713s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:17 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:13:17 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Converted 1024.00 MB image at 166.55 MB/s Apr 24 01:13:17 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 is being set with open permissions: ugo+rw Apr 24 01:13:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:17 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 Apr 24 01:13:17 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:18 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1" returned: 0 in 0.529s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-fb1a5b29-330c-4a4c-a870-408a14d030f1" released by "_copy_volume_from_snapshot" :: held 9.068s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-6d2757af-0db1-4869-bf56-09eaf0c0b6d5-fb1a5b29-330c-4a4c-a870-408a14d030f1" released by "_create_volume_from_snapshot" :: held 9.120s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.183s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.630s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a2fc080b-83f4-44c5-9122-1aa1cbad567d,created_at=2026-04-23T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1344169215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2fc080b-83f4-44c5-9122-1aa1cbad567d,host='devstack@QuobyteHD#QuobyteHD',id=af0d9313-fab8-4ea9-934b-6f0b08981a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26cbb074f9c24ef28df9dca786dd609c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:10Z,use_quota=True,user_id='2d3322478af0412ba1770a4454d3a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb2ac26a-992f-4d2c-a2f8-f978381c1230),volume_type_id=bb2ac26a-992f-4d2c-a2f8-f978381c1230)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Creating volume af0d9313-fab8-4ea9-934b-6f0b08981a6b {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:13:18 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:18 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b 1073741824 Apr 24 01:13:18 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f9b7cd-3588-4913-8a8c-bdd9d4902773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1a5b29-330c-4a4c-a870-408a14d030f1', 'volume_size': 1, 'snapshot_id': '6d2757af-0db1-4869-bf56-09eaf0c0b6d5'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91316fc4-b846-4525-8320-f15d7f3f77d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:18 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Volume volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 (fb1a5b29-330c-4a4c-a870-408a14d030f1): created successfully Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91316fc4-b846-4525-8320-f15d7f3f77d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Flow 'volume_create_manager' (da09bcf9-587d-4d1f-beb9-5a8a7dc4de37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:18 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b6773695-a748-4faf-aa05-3af2f0b0a070 tempest-VolumeDependencyTests-1522854737 None] Created volume successfully. Apr 24 01:13:18 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b 1073741824" returned: 0 in 0.654s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:18 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b Apr 24 01:13:18 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-6d2757af-0db1-4869-bf56-09eaf0c0b6d5-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-6d2757af-0db1-4869-bf56-09eaf0c0b6d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-342eed7e-f3f1-40e6-a99b-899435586b22" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-342eed7e-f3f1-40e6-a99b-899435586b22" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-6d2757af-0db1-4869-bf56-09eaf0c0b6d5" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-6d2757af-0db1-4869-bf56-09eaf0c0b6d5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Deleting offline snapshot 6d2757af-0db1-4869-bf56-09eaf0c0b6d5 of volume 342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] snapshot_file for this snap is: volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf74a73-8423-44de-9520-114d3dc429f9]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:19 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 Apr 24 01:13:19 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:19 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b" returned: 0 in 0.665s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.043s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2022824326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c68ee62-42bc-4930-8755-e19b3e62cbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:15Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Creating volume 3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:13:19 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=177,cinder:UPDATE=219,cinder:DELETE=18,cinder:INSERT=49 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f9ab90-437a-41d5-9b91-7b330fa5ed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:19 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 1073741824 Apr 24 01:13:19 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cd7055-f46f-4a80-a2ed-90e52e9ac42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=187,cinder:INSERT=61,cinder:UPDATE=249,cinder:DELETE=13 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:13:19 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Volume volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b (af0d9313-fab8-4ea9-934b-6f0b08981a6b): created successfully Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cd7055-f46f-4a80-a2ed-90e52e9ac42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Flow 'volume_create_manager' (fa5fa604-13dc-48df-923c-94f65ad546a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:19 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-51128f92-ea0d-47a7-a132-f491f66ea1fc tempest-GroupsTest-518410138 None] Created volume successfully. Apr 24 01:13:19 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5" returned: 0 in 0.725s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-342eed7e-f3f1-40e6-a99b-899435586b22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[784dc55d-68f3-40f4-bbb7-02ec4484b1a8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:20 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 Apr 24 01:13:20 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:20 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 1073741824" returned: 0 in 0.874s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:20 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 Apr 24 01:13:20 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:20 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22" returned: 0 in 0.644s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:20 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 Apr 24 01:13:20 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a0604d2f-d9e7-4779-86a6-d1937f6217e3 tempest-GroupsTest-518410138 None] Update group completed successfully. Apr 24 01:13:21 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2" returned: 0 in 0.582s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2392206a-e271-42cc-8d74-0fb7bb051291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b33145-33db-4c51-af33-daa2ca55b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:21 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Volume volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 (3c68ee62-42bc-4930-8755-e19b3e62cbe2): created successfully Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b33145-33db-4c51-af33-daa2ca55b182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (f91d2a48-aa31-48e7-b86c-79b929654b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-56cf5b8f-ccc4-4c45-99d8-f75b05489ec9 tempest-VolumesGetTest-1436487431 None] Created volume successfully. Apr 24 01:13:21 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5" returned: 0 in 0.679s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:21 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5 Apr 24 01:13:21 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:21 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22.6d2757af-0db1-4869-bf56-09eaf0c0b6d5" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-6d2757af-0db1-4869-bf56-09eaf0c0b6d5" released by "_delete_snapshot" :: held 2.691s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-342eed7e-f3f1-40e6-a99b-899435586b22" released by "delete_snapshot" :: held 2.720s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:21 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Created reservations ['d04c958c-31a5-4c46-9266-97df0871698f', 'a8f42c54-221c-4ae1-9fab-f578a24e097d', 'e3247d84-ca38-4bf9-a590-8f5b28b1906e', '10fc292d-4bce-4172-b7cc-a940d3f45974'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Delete snapshot completed successfully. Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-bca2a0eb-1d9d-4982-b02f-05f89514b890 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-6d2757af-0db1-4869-bf56-09eaf0c0b6d5-delete_snapshot" released by "delete_snapshot" :: held 3.001s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (e6f8f6e7-95a6-4bcd-8068-ba4b40cb7607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6cf975-319d-4835-8d46-efef7d7e04eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6cf975-319d-4835-8d46-efef7d7e04eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-98955280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7a468e-321f-4180-bcb8-1546798aece4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3c68ee62-42bc-4930-8755-e19b3e62cbe2,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:22Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a05fd21-6396-4126-9490-40c85c8d34ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a05fd21-6396-4126-9490-40c85c8d34ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc32df95-57d1-4bba-b3b5-c9d39b9dad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc32df95-57d1-4bba-b3b5-c9d39b9dad7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'af7a468e-321f-4180-bcb8-1546798aece4', 'volume_name': 'volume-af7a468e-321f-4180-bcb8-1546798aece4', 'volume_size': 1, 'source_volid': '3c68ee62-42bc-4930-8755-e19b3e62cbe2', 'source_volstatus': 'available'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760dfe39-7668-46f4-bdce-b20fec521f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760dfe39-7668-46f4-bdce-b20fec521f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6fbd62-3d70-4079-89f0-75bc7f452a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:22 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Volume af7a468e-321f-4180-bcb8-1546798aece4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-af7a468e-321f-4180-bcb8-1546798aece4', 'volume_size': 1, 'source_volid': '3c68ee62-42bc-4930-8755-e19b3e62cbe2', 'source_volstatus': 'available'} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:22 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Cloning volume 3c68ee62-42bc-4930-8755-e19b3e62cbe2 to volume af7a468e-321f-4180-bcb8-1546798aece4 Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Creating offline snapshot d2525225-9677-446a-b50d-e6c3057b15d7 of volume 3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-342eed7e-f3f1-40e6-a99b-899435586b22-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf6544d-b9f0-421a-842e-3b40b4c3e6f6]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-342eed7e-f3f1-40e6-a99b-899435586b22-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-342eed7e-f3f1-40e6-a99b-899435586b22" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-342eed7e-f3f1-40e6-a99b-899435586b22" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4eaded-91cd-413a-86ed-bf9216b12e57]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:22 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 Apr 24 01:13:22 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-fa5a7deb-7b61-4601-a826-b71cb4210e9f tempest-GroupsTest-518410138 None] Update group completed successfully. Apr 24 01:13:22 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 Apr 24 01:13:22 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:23 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2" returned: 0 in 0.736s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:23 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 1G Apr 24 01:13:23 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:23 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22" returned: 0 in 0.807s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:23 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22 Apr 24 01:13:23 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:23 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 1G" returned: 0 in 0.878s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:23 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-342eed7e-f3f1-40e6-a99b-899435586b22" returned: 0 in 0.712s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:23 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 Apr 24 01:13:24 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-342eed7e-f3f1-40e6-a99b-899435586b22" released by "delete_volume" :: held 1.598s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Created reservations ['d137925f-4336-46ab-831d-3fb360498fc2', '2cbaafdb-a45c-44d6-80ea-91cc08567195', '6bf50161-8c5b-46fe-a504-5421a077048e', '703e3f41-a6dd-48e4-8ef6-abbd35d9c7a5'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Acquiring lock "cinder-quobyte-87e4fdce-732e-4c15-b3f8-7d756295378b" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Lock "cinder-quobyte-87e4fdce-732e-4c15-b3f8-7d756295378b" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87c40d-0718-4088-88de-0e968ed078f8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:24 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b Apr 24 01:13:24 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:24 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:24 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:24 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7" returned: 0 in 1.017s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:24 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 is being set with open permissions: ugo+rw Apr 24 01:13:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:25 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 Apr 24 01:13:25 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Flow 'volume_create_manager' (debcce1c-0c13-49a7-a0e3-374214a978e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fca29ea-b057-4e55-9aa8-00bb86f1e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:25 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fca29ea-b057-4e55-9aa8-00bb86f1e052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-913202321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab44b33-e2ec-49e4-8821-58637b1031cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71676b1bafff4e1cb33835487c4af368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:25Z,use_quota=True,user_id='b2467187db00499ea6c302ce81e1584a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f057fca-d30f-4ae3-a615-b59bc46d91fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f057fca-d30f-4ae3-a615-b59bc46d91fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d5645b-7a0b-4619-858c-51cc20a3bd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d5645b-7a0b-4619-858c-51cc20a3bd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab44b33-e2ec-49e4-8821-58637b1031cb', 'volume_name': 'volume-dab44b33-e2ec-49e4-8821-58637b1031cb', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7946d83-90a4-4991-901b-e640b9f2dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7946d83-90a4-4991-901b-e640b9f2dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedd173e-b019-4474-a454-86e8841a0c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Volume dab44b33-e2ec-49e4-8821-58637b1031cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab44b33-e2ec-49e4-8821-58637b1031cb', 'volume_size': 1} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.086s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:25 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Deleted volume successfully. Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8add6cb0-d8f6-41b2-92f5-dadee64fd5ca tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-342eed7e-f3f1-40e6-a99b-899435586b22-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:25 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b" returned: 0 in 1.152s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:25 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b Apr 24 01:13:25 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:25 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7" returned: 0 in 0.646s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:25 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.info Apr 24 01:13:25 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:25 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-87e4fdce-732e-4c15-b3f8-7d756295378b" returned: 0 in 0.503s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Lock "cinder-quobyte-87e4fdce-732e-4c15-b3f8-7d756295378b" released by "delete_volume" :: held 1.727s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Acquiring lock "cinder-quobyte-af0d9313-fab8-4ea9-934b-6f0b08981a6b" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Lock "cinder-quobyte-af0d9313-fab8-4ea9-934b-6f0b08981a6b" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[804f69ae-4d09-4250-a0d7-ae29d328d06b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:26 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b Apr 24 01:13:26 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:26 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.info" returned: 0 in 0.517s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:26 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.info is being set with open permissions: ugo+rw Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:26 devstack sudo[87367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.info Apr 24 01:13:26 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:26 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b" returned: 0 in 0.668s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:26 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b Apr 24 01:13:26 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:26 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.info" returned: 0 in 0.573s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-af7a468e-321f-4180-bcb8-1546798aece4" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-af7a468e-321f-4180-bcb8-1546798aece4" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] snapshot: d2525225-9677-446a-b50d-e6c3057b15d7, volume: af7a468e-321f-4180-bcb8-1546798aece4, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[09501c43-50a6-4712-9ba5-1939720c72aa]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:26 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 Apr 24 01:13:26 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:27 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af0d9313-fab8-4ea9-934b-6f0b08981a6b" returned: 0 in 0.550s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Lock "cinder-quobyte-af0d9313-fab8-4ea9-934b-6f0b08981a6b" released by "delete_volume" :: held 1.271s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Created reservations ['f6033c8a-fb06-4f80-a079-3449847fc13a'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:27 devstack cinder-volume[81925]: WARNING cinder.quota [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-193358262 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-193358262, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:13:27 devstack cinder-volume[81925]: WARNING cinder.quota [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-193358262 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-193358262, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Created reservations ['1c3d87a1-853b-4703-aec8-557a755af422', '9081ddb9-01f3-4cfc-8161-9a9ed467aa93', 'c904806a-bd26-4da1-a473-cc1a0ce41e74', '3629a7d9-9d44-4050-b07d-18d72228f020'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:27 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7" returned: 0 in 0.684s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Created reservations ['9c706070-4e9a-49cc-93c2-04184ee4d411', '41c4adf4-9c15-48ef-87f1-0f36ed986a9d', '13f787bb-5363-4ce2-acbc-00757e9f2159', 'f3f9aefb-d6cf-4fa8-8859-4f6657bc9151'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[441b9239-0daf-483f-a7e6-0c0964a72a43]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:27 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 Apr 24 01:13:27 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:27 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:27 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:28 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.554s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:28 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b91a3505-b8ce-442e-839c-633dc9cbd7fc tempest-GroupsTest-518410138 None] Delete group completed successfully. Apr 24 01:13:28 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2" returned: 0 in 0.686s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:28 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:13:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:28 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 Apr 24 01:13:28 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:35 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4" returned: 0 in 6.918s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:35 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffc1c6b-d7d6-432e-b1d3-e85d3fa5c375]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:35 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 Apr 24 01:13:35 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:35 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2" returned: 0 in 0.771s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:35 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:13:35 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Converted 1024.00 MB image at 147.98 MB/s Apr 24 01:13:35 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 is being set with open permissions: ugo+rw Apr 24 01:13:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:35 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 Apr 24 01:13:35 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:36 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4" returned: 0 in 0.602s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:36 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-672f78c1-792e-4dd7-bfcf-e0f037a21f3e tempest-GroupsV320Test-990783828 None] Group tempest-GroupsV320Test-Group-1584160364: creating Apr 24 01:13:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-af7a468e-321f-4180-bcb8-1546798aece4" released by "_copy_volume_from_snapshot" :: held 9.772s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:36 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-672f78c1-792e-4dd7-bfcf-e0f037a21f3e tempest-GroupsV320Test-990783828 None] Group tempest-GroupsV320Test-Group-1584160364: created successfully Apr 24 01:13:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-d2525225-9677-446a-b50d-e6c3057b15d7" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:36 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-672f78c1-792e-4dd7-bfcf-e0f037a21f3e tempest-GroupsV320Test-990783828 None] Create group completed successfully. Apr 24 01:13:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-d2525225-9677-446a-b50d-e6c3057b15d7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Deleting offline snapshot d2525225-9677-446a-b50d-e6c3057b15d7 of volume 3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:13:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] snapshot_file for this snap is: volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:13:36 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46e7d7-89b5-4c13-b81b-40bf0b7491db]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:36 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 Apr 24 01:13:36 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:37 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7" returned: 0 in 0.522s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:13:37 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2e42f7-9278-4753-8eda-c258329e5324]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:37 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 Apr 24 01:13:37 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:37 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2" returned: 0 in 0.615s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:37 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 Apr 24 01:13:37 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Created reservations ['c1508a10-4bdc-4f77-a664-3371212b969b'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:38 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:38 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:38 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7" returned: 0 in 0.637s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:38 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7 Apr 24 01:13:38 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:38 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.553s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:38 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0da5abb5-4103-4c8c-959b-26eaf2a09bb6 tempest-GroupsV320Test-990783828 None] Delete group completed successfully. Apr 24 01:13:38 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2.d2525225-9677-446a-b50d-e6c3057b15d7" returned: 0 in 0.517s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-d2525225-9677-446a-b50d-e6c3057b15d7" released by "_delete_snapshot" :: held 2.382s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.762s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.657s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-913202321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab44b33-e2ec-49e4-8821-58637b1031cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71676b1bafff4e1cb33835487c4af368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:25Z,use_quota=True,user_id='b2467187db00499ea6c302ce81e1584a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Creating volume dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:13:39 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:39 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb 1073741824 Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6fbd62-3d70-4079-89f0-75bc7f452a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7a468e-321f-4180-bcb8-1546798aece4', 'volume_size': 1, 'source_volid': '3c68ee62-42bc-4930-8755-e19b3e62cbe2', 'source_volstatus': 'available'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:39 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac46b0b-fb9b-42cb-af51-aa7dc03839b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:39 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Volume volume-af7a468e-321f-4180-bcb8-1546798aece4 (af7a468e-321f-4180-bcb8-1546798aece4): created successfully Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac46b0b-fb9b-42cb-af51-aa7dc03839b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (e6f8f6e7-95a6-4bcd-8068-ba4b40cb7607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:39 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-92999f47-8328-4d4f-b490-55995638d03b tempest-VolumesGetTest-1436487431 None] Created volume successfully. Apr 24 01:13:39 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb 1073741824" returned: 0 in 0.778s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:39 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb Apr 24 01:13:39 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:40 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb" returned: 0 in 0.763s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedd173e-b019-4474-a454-86e8841a0c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab44b33-e2ec-49e4-8821-58637b1031cb', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50df57bf-142f-4032-a50c-32815d718227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:40 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Volume volume-dab44b33-e2ec-49e4-8821-58637b1031cb (dab44b33-e2ec-49e4-8821-58637b1031cb): created successfully Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50df57bf-142f-4032-a50c-32815d718227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Flow 'volume_create_manager' (debcce1c-0c13-49a7-a0e3-374214a978e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a56d2e92-5665-403b-8c08-d1eb30cebd76 tempest-VolumeDependencyTests-1522854737 None] Created volume successfully. Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (2537067a-72aa-4cf6-bae7-e35bf160a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b20c91-6df9-475c-94e3-f74ad4cf1169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b20c91-6df9-475c-94e3-f74ad4cf1169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1557899033',display_name='tempest-VolumesGetTest-Volume-1196804879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1263d5f8-e1e3-4d57-a0ba-0b855220ec4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:41Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9838957c-b889-4834-b437-95204f982006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9838957c-b889-4834-b437-95204f982006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1db0b58-1ebd-448f-816b-d0ffd610f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1db0b58-1ebd-448f-816b-d0ffd610f161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1263d5f8-e1e3-4d57-a0ba-0b855220ec4f', 'volume_name': 'volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0c4016-c9f9-4053-b9d1-ec310d7584b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0c4016-c9f9-4053-b9d1-ec310d7584b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cea01c-cda4-4076-87ad-b8d04cf16ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:40 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Volume 1263d5f8-e1e3-4d57-a0ba-0b855220ec4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f', 'volume_size': 1} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1557899033',display_name='tempest-VolumesGetTest-Volume-1196804879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1263d5f8-e1e3-4d57-a0ba-0b855220ec4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:41Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Creating volume 1263d5f8-e1e3-4d57-a0ba-0b855220ec4f {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:13:40 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:13:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:40 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f 1073741824 Apr 24 01:13:40 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:41 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f 1073741824" returned: 0 in 0.996s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:41 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f Apr 24 01:13:41 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Flow 'volume_create_manager' (5db784d8-e6b0-4d4b-b98f-ad2732f79691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0239b1fd-ace4-4196-9b92-79a96f691e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0239b1fd-ace4-4196-9b92-79a96f691e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2060164968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba792f7-be5c-492c-8a59-f3b697d08e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71676b1bafff4e1cb33835487c4af368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dab44b33-e2ec-49e4-8821-58637b1031cb,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:42Z,use_quota=True,user_id='b2467187db00499ea6c302ce81e1584a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1373370c-7425-4acc-b8f1-930e7934a570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1373370c-7425-4acc-b8f1-930e7934a570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e643ca4-a114-439a-a86a-0937e3c04989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e643ca4-a114-439a-a86a-0937e3c04989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8ba792f7-be5c-492c-8a59-f3b697d08e4f', 'volume_name': 'volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f', 'volume_size': 1, 'source_volid': 'dab44b33-e2ec-49e4-8821-58637b1031cb', 'source_volstatus': 'available'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ae0d65-555c-4e6f-b11c-3c93e1f0081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ae0d65-555c-4e6f-b11c-3c93e1f0081b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9086d7-fa32-4d46-b077-147914a856a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:42 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Volume 8ba792f7-be5c-492c-8a59-f3b697d08e4f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f', 'volume_size': 1, 'source_volid': 'dab44b33-e2ec-49e4-8821-58637b1031cb', 'source_volstatus': 'available'} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:42 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f" returned: 0 in 1.008s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.212s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:42 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Cloning volume dab44b33-e2ec-49e4-8821-58637b1031cb to volume 8ba792f7-be5c-492c-8a59-f3b697d08e4f Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cea01c-cda4-4076-87ad-b8d04cf16ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040e1e06-d45b-4cbc-a64c-91080545e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:42 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Volume volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f (1263d5f8-e1e3-4d57-a0ba-0b855220ec4f): created successfully Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040e1e06-d45b-4cbc-a64c-91080545e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (2537067a-72aa-4cf6-bae7-e35bf160a244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Creating offline snapshot 115e8e23-2b12-4b9a-ab95-a9f33f88a819 of volume dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:13:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e20c204e-c1de-49a3-a0b5-f14d3da62ecd tempest-VolumesGetTest-1436487431 None] Created volume successfully. Apr 24 01:13:43 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[293be204-c75c-4217-ae56-973f836fa26e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:43 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb Apr 24 01:13:43 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:43 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb" returned: 0 in 0.738s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:43 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 1G Apr 24 01:13:43 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Lock "cinder-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f" acquired by "delete_volume" :: waited 0.052s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:44 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[879e4f91-e1a7-4a28-a2b9-9eb466e8281a]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:44 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 1G" returned: 0 in 1.126s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab44b33-e2ec-49e4-8821-58637b1031cb -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:44 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f Apr 24 01:13:44 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:44 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab44b33-e2ec-49e4-8821-58637b1031cb -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 Apr 24 01:13:44 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:45 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:45 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab44b33-e2ec-49e4-8821-58637b1031cb -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819" returned: 0 in 0.968s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:45 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 is being set with open permissions: ugo+rw Apr 24 01:13:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f" returned: 0 in 1.127s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:45 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 Apr 24 01:13:45 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:45 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f Apr 24 01:13:45 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:46 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f" returned: 0 in 0.536s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f" released by "delete_volume" :: held 1.731s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Created reservations ['8aa6e37b-d9a0-47c4-9450-2fbe21d6d47e', '7e8571d1-ef52-4765-84eb-5732c26c64f7', '1b3f77a2-c8bd-4c79-9f38-e6d874c4235b', '908c8d3b-def1-4a75-9c8d-d37a05d1e172'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:46 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:46 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:46 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819" returned: 0 in 1.092s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:47 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.info Apr 24 01:13:47 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-af7a468e-321f-4180-bcb8-1546798aece4-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Lock "cinder-af7a468e-321f-4180-bcb8-1546798aece4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-af7a468e-321f-4180-bcb8-1546798aece4" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-af7a468e-321f-4180-bcb8-1546798aece4" acquired by "delete_volume" :: waited 0.032s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0344d2c-269f-4723-a18e-30843e237311]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:47 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 Apr 24 01:13:47 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:47 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.824s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Deleted volume successfully. Apr 24 01:13:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2e743c68-2c31-4c56-95eb-6b70b76eecac tempest-VolumesGetTest-1436487431 None] Lock "cinder-1263d5f8-e1e3-4d57-a0ba-0b855220ec4f-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:48 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.info" returned: 0 in 1.168s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:48 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.info is being set with open permissions: ugo+rw Apr 24 01:13:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:48 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.info Apr 24 01:13:48 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:48 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4" returned: 0 in 1.004s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:48 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4 Apr 24 01:13:48 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:48 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7a468e-321f-4180-bcb8-1546798aece4" returned: 0 in 0.683s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:49 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.info" returned: 0 in 0.853s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-8ba792f7-be5c-492c-8a59-f3b697d08e4f" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-af7a468e-321f-4180-bcb8-1546798aece4" released by "delete_volume" :: held 1.794s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-8ba792f7-be5c-492c-8a59-f3b697d08e4f" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] snapshot: 115e8e23-2b12-4b9a-ab95-a9f33f88a819, volume: 8ba792f7-be5c-492c-8a59-f3b697d08e4f, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dc36a8-baae-4589-aeb0-bd844ef40ee8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Created reservations ['70049a23-8430-44d0-a137-6ed1f11e31d3', 'de2495ab-fce8-4b56-8132-985b2fdac108', '7f6ba1fc-d675-4f4a-b8ff-a2662b63be12', 'ce536550-54d3-4f8b-9bd0-91a07f1a13a5'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:49 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:49 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 Apr 24 01:13:49 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:49 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-3c68ee62-42bc-4930-8755-e19b3e62cbe2-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Lock "cinder-3c68ee62-42bc-4930-8755-e19b3e62cbe2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-3c68ee62-42bc-4930-8755-e19b3e62cbe2" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-3c68ee62-42bc-4930-8755-e19b3e62cbe2" acquired by "delete_volume" :: waited 0.027s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713b01e-83ad-4dd5-816b-2ff79e2bc022]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:50 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 Apr 24 01:13:50 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:50 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.984s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:50 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Deleted volume successfully. Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b7611295-32ce-4ee2-83d5-190825b6b617 tempest-VolumesGetTest-1436487431 None] Lock "cinder-af7a468e-321f-4180-bcb8-1546798aece4-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:50 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819" returned: 0 in 1.587s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab44b33-e2ec-49e4-8821-58637b1031cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6516c3f-f201-419a-a7e0-708fc9088cf9]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:50 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb Apr 24 01:13:50 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:50 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2" returned: 0 in 1.135s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:50 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2 Apr 24 01:13:50 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:51 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb" returned: 0 in 0.810s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:51 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:13:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:51 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f Apr 24 01:13:51 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:52 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3c68ee62-42bc-4930-8755-e19b3e62cbe2" returned: 0 in 1.092s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-3c68ee62-42bc-4930-8755-e19b3e62cbe2" released by "delete_volume" :: held 2.329s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Created reservations ['2fcdd43a-6714-45c8-bb48-bf576c8bb099', 'f234770c-ea45-4e15-a8e6-c6abe39b6836', 'c4c4dde8-ae9a-437a-8c8a-78d0d65e5771', 'b6697e3c-02b8-4545-a48a-8187c2c27737'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:13:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:52 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:13:52 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:55 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 2.681s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:13:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Deleted volume successfully. Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00f4a11d-433e-4ff5-8a4c-67f34dd036cd tempest-VolumesGetTest-1436487431 None] Lock "cinder-3c68ee62-42bc-4930-8755-e19b3e62cbe2-delete_volume" released by "delete_volume" :: held 5.667s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (50012efa-1c76-4328-a6a3-8787b0723ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e451c57-2167-401d-b8e6-a68a6ab49e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e451c57-2167-401d-b8e6-a68a6ab49e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1608517450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e9a6b5-76e4-41e8-ac56-8bb42a59113c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:56Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200fc539-7a42-4b32-bcaf-5fc1f22372e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200fc539-7a42-4b32-bcaf-5fc1f22372e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c085f98-06a3-4fd5-b7fa-13bcab7e970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:55 devstack cinder-volume[81925]: DEBUG cinder.image.glance [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Creating Keystone auth plugin from conf {{(pid=81925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 01:13:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c085f98-06a3-4fd5-b7fa-13bcab7e970f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00e9a6b5-76e4-41e8-ac56-8bb42a59113c', 'volume_name': 'volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21540be3-1f67-4a5d-845e-83da928098a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21540be3-1f67-4a5d-845e-83da928098a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c665178b-5d04-492c-a77e-73e32d91e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:57 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Volume 00e9a6b5-76e4-41e8-ac56-8bb42a59113c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 01:13:57 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Trying to clone 00e9a6b5-76e4-41e8-ac56-8bb42a59113c from image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]). {{(pid=81925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 01:13:57 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 01:13:57 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Image download 20.69 MB at 20.69 MB/s Apr 24 01:13:58 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b88cba-2f21-48d9-9380-e164c62d1bdd]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:13:58 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD Apr 24 01:13:58 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:13:58 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Flow 'volume_create_manager' (2ba387ae-be2b-4883-a43d-ba241f9766df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de29c5f-9939-4273-8044-5c0ab6aed1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de29c5f-9939-4273-8044-5c0ab6aed1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-213496939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1649223e-0c1e-4a2e-a17c-a08fb15284b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba44d49c71644a996de3f570abf14a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:59Z,use_quota=True,user_id='83efef7feed845a4a68f2918fc4d8301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f3548c0-b386-42b5-aa3e-e06625a0889e),volume_type_id=8f3548c0-b386-42b5-aa3e-e06625a0889e)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10eab7d-8adc-41d4-b0e6-3b04ea87251f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10eab7d-8adc-41d4-b0e6-3b04ea87251f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d885046e-722f-43da-8888-6ae8afe803b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d885046e-722f-43da-8888-6ae8afe803b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1649223e-0c1e-4a2e-a17c-a08fb15284b4', 'volume_name': 'volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15806bb9-6ed8-4f7d-8024-ee5999f7e2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15806bb9-6ed8-4f7d-8024-ee5999f7e2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ea5b41-6735-4034-ac48-8fd7dd24d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:13:59 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Volume 1649223e-0c1e-4a2e-a17c-a08fb15284b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4', 'volume_size': 1} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:13:59 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD" returned: 0 in 1.743s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Temporary image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 is fetched for user a3518c654890475b9ba3d4c1a9045f03. {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[33946852-5907-4f50-a05b-b5d1dbb2260d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:13:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:00 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD Apr 24 01:14:00 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:00 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f" returned: 0 in 8.510s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:00 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f72de35-25c3-47b7-a817-c70e8c1c6082]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:00 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb Apr 24 01:14:00 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:00 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD" returned: 0 in 0.652s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:00 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb" returned: 0 in 0.763s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:00 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:14:00 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Converted 1024.00 MB image at 120.30 MB/s Apr 24 01:14:00 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f is being set with open permissions: ugo+rw Apr 24 01:14:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:00 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f Apr 24 01:14:00 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:01 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f" returned: 0 in 0.523s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-8ba792f7-be5c-492c-8a59-f3b697d08e4f" released by "_copy_volume_from_snapshot" :: held 12.358s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-115e8e23-2b12-4b9a-ab95-a9f33f88a819" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-115e8e23-2b12-4b9a-ab95-a9f33f88a819" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Deleting offline snapshot 115e8e23-2b12-4b9a-ab95-a9f33f88a819 of volume dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:14:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] snapshot_file for this snap is: volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:14:01 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba24a42-4715-4ba1-8849-a4845972a59e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:01 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 Apr 24 01:14:01 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:02 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819" returned: 0 in 0.550s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab44b33-e2ec-49e4-8821-58637b1031cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:14:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10c3fad-8fc6-4957-8508-4a155e3ff3d9]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:02 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb Apr 24 01:14:02 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:02 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb" returned: 0 in 0.596s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:02 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 Apr 24 01:14:02 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:03 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819" returned: 0 in 0.606s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:03 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819 Apr 24 01:14:03 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:03 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb.115e8e23-2b12-4b9a-ab95-a9f33f88a819" returned: 0 in 0.459s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-115e8e23-2b12-4b9a-ab95-a9f33f88a819" released by "_delete_snapshot" :: held 2.304s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.960s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.644s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-213496939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1649223e-0c1e-4a2e-a17c-a08fb15284b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba44d49c71644a996de3f570abf14a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:59Z,use_quota=True,user_id='83efef7feed845a4a68f2918fc4d8301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f3548c0-b386-42b5-aa3e-e06625a0889e),volume_type_id=8f3548c0-b386-42b5-aa3e-e06625a0889e)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Creating volume 1649223e-0c1e-4a2e-a17c-a08fb15284b4 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:03 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9086d7-fa32-4d46-b077-147914a856a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f', 'volume_size': 1, 'source_volid': 'dab44b33-e2ec-49e4-8821-58637b1031cb', 'source_volstatus': 'available'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ddd812-9a64-4078-826e-fb3ce95f4da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:03 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 1073741824 Apr 24 01:14:03 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:03 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Volume volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f (8ba792f7-be5c-492c-8a59-f3b697d08e4f): created successfully Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ddd812-9a64-4078-826e-fb3ce95f4da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Flow 'volume_create_manager' (5db784d8-e6b0-4d4b-b98f-ad2732f79691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:03 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-00cf64b5-aeeb-469c-b0c7-831648b0d4dd tempest-VolumeDependencyTests-1522854737 None] Created volume successfully. Apr 24 01:14:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-dab44b33-e2ec-49e4-8821-58637b1031cb-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-dab44b33-e2ec-49e4-8821-58637b1031cb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-dab44b33-e2ec-49e4-8821-58637b1031cb" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-dab44b33-e2ec-49e4-8821-58637b1031cb" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:04 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e47695-cefa-461d-a4e9-92ccb3d6b686]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:04 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb Apr 24 01:14:04 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:04 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 1073741824" returned: 0 in 0.798s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:04 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 Apr 24 01:14:04 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:05 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb" returned: 0 in 0.781s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:05 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb Apr 24 01:14:05 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:05 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4" returned: 0 in 0.798s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.938s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1608517450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e9a6b5-76e4-41e8-ac56-8bb42a59113c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:13:56Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Creating volume 00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:05 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:05 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c 1073741824 Apr 24 01:14:05 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ea5b41-6735-4034-ac48-8fd7dd24d37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2db600-04bd-48a4-9c02-8da13f27180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:05 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Volume volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 (1649223e-0c1e-4a2e-a17c-a08fb15284b4): created successfully Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2db600-04bd-48a4-9c02-8da13f27180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Flow 'volume_create_manager' (2ba387ae-be2b-4883-a43d-ba241f9766df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:05 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4092374c-e25f-4003-bd73-33b69001cce5 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Created volume successfully. Apr 24 01:14:05 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dab44b33-e2ec-49e4-8821-58637b1031cb" returned: 0 in 0.796s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-dab44b33-e2ec-49e4-8821-58637b1031cb" released by "delete_volume" :: held 1.665s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Created reservations ['cd815b5e-b8c9-4139-a512-028c6204356b', '1c4fb19c-0e1b-4ef1-8ff2-73122108805c', '82c82d31-502d-4cdc-90bd-4de4269d00cf', 'f99f8634-9d1c-4f79-8406-06e10c6c1d66'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:06 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:06 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:06 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c 1073741824" returned: 0 in 0.787s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:06 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c Apr 24 01:14:06 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-8ba792f7-be5c-492c-8a59-f3b697d08e4f-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-8ba792f7-be5c-492c-8a59-f3b697d08e4f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-8ba792f7-be5c-492c-8a59-f3b697d08e4f" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-8ba792f7-be5c-492c-8a59-f3b697d08e4f" acquired by "delete_volume" :: waited 0.047s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[11219c48-86b4-4eaf-8075-3eddd51f0235]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:07 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f Apr 24 01:14:07 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:07 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.135s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:07 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Deleted volume successfully. Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53f2bba6-4b46-4430-a573-bdb7c585d2cb tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-dab44b33-e2ec-49e4-8821-58637b1031cb-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:07 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" returned: 0 in 1.062s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Attempting download of a7c3cef6-73f5-4af2-9de8-0bc5792d6063 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}])) to volume 00e9a6b5-76e4-41e8-ac56-8bb42a59113c. {{(pid=81925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b095299-be68-4202-a4a0-266e2bb04835]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_kwdc6g3y {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:07 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_kwdc6g3y Apr 24 01:14:07 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:07 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:07 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:07 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f" returned: 0 in 0.982s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:07 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f Apr 24 01:14:07 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:08 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_kwdc6g3y" returned: 0 in 1.214s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_kwdc6g3y {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:08 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.139s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:08 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:08 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-abd65352-0538-4328-9ea4-02e9327c59a4 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Retype volume completed successfully. Apr 24 01:14:08 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8ba792f7-be5c-492c-8a59-f3b697d08e4f" returned: 0 in 0.984s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-8ba792f7-be5c-492c-8a59-f3b697d08e4f" released by "delete_volume" :: held 2.068s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:08 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_kwdc6g3y Apr 24 01:14:08 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Created reservations ['1cf018de-e28d-4fdd-b536-80dde2f7555e', 'e736524f-85a5-4d3d-8f9d-97c91662a4c7', 'e7db6259-94b6-46dd-b99f-a2933264aca2', 'fc1729c8-fedf-4bb0-b74f-4094d22ed861'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:09 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:09 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Acquiring lock "cinder-1649223e-0c1e-4a2e-a17c-a08fb15284b4-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "cinder-1649223e-0c1e-4a2e-a17c-a08fb15284b4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-fb1a5b29-330c-4a4c-a870-408a14d030f1-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-fb1a5b29-330c-4a4c-a870-408a14d030f1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Acquiring lock "cinder-quobyte-1649223e-0c1e-4a2e-a17c-a08fb15284b4" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "cinder-quobyte-fb1a5b29-330c-4a4c-a870-408a14d030f1" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "cinder-quobyte-1649223e-0c1e-4a2e-a17c-a08fb15284b4" acquired by "delete_volume" :: waited 0.043s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-fb1a5b29-330c-4a4c-a870-408a14d030f1" acquired by "delete_volume" :: waited 0.035s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae316607-65a1-42f6-8e0f-10cd70252471]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b7ded-2401-4acc-a634-eea2194b7e7c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:09 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 Apr 24 01:14:09 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:09 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 Apr 24 01:14:09 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:09 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_kwdc6g3y" returned: 1 in 0.933s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_kwdc6g3y' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1635177a-5cd1-4f4f-b1b6-2be314b3b0b2]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:09 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD Apr 24 01:14:09 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:10 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.017s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:10 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Deleted volume successfully. Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-34229a60-523e-415d-bd09-814172be9394 tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-8ba792f7-be5c-492c-8a59-f3b697d08e4f-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:10 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4" returned: 0 in 1.028s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:10 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4 Apr 24 01:14:10 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:10 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1" returned: 0 in 1.130s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:10 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1 Apr 24 01:14:10 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:10 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD" returned: 0 in 1.060s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] a7c3cef6-73f5-4af2-9de8-0bc5792d6063 was qcow2, converting to raw {{(pid=81925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 01:14:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:10 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c Apr 24 01:14:10 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:11 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1649223e-0c1e-4a2e-a17c-a08fb15284b4" returned: 0 in 0.509s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "cinder-quobyte-1649223e-0c1e-4a2e-a17c-a08fb15284b4" released by "delete_volume" :: held 1.666s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:11 devstack cinder-volume[81925]: WARNING cinder.quota [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:14:11 devstack cinder-volume[81925]: WARNING cinder.quota [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 01:14:11 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fb1a5b29-330c-4a4c-a870-408a14d030f1" returned: 0 in 0.485s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Created reservations ['2453a772-5547-4575-85b7-cbf84fc9a80f', 'cbdebbea-daf3-4389-af2e-43f49924dfcc', '0550192a-c825-4a53-a519-c180642c3f89', '411c49a8-b1e5-4bf9-85d9-8f6e8f533475'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-quobyte-fb1a5b29-330c-4a4c-a870-408a14d030f1" released by "delete_volume" :: held 1.740s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Created reservations ['f81b5f95-5da1-4838-b2a9-d76268afae3f', '7d472db7-73d2-4f02-b6cd-c2327cafdb57', '960c14f5-eea6-403a-8420-cc42679fac1d', '681d9bc8-0d7f-4625-9280-a1b38fb8ff05'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:11 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:11 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:11 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:11 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:11 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:11 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:12 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.036s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:12 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Deleted volume successfully. Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-576f8510-327f-446d-a8a9-71b3d697c352 tempest-VolumeRetypeWithoutMigrationTest-1311018927 None] Lock "cinder-1649223e-0c1e-4a2e-a17c-a08fb15284b4-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:12 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" returned: 0 in 1.846s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_c76utflfdevstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:14:12 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Converted 112.00 MB image at 60.65 MB/s Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:12 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.193s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:12 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Deleted volume successfully. Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2b106669-7d8b-4aeb-a5a3-6849e718c26e tempest-VolumeDependencyTests-1522854737 None] Lock "cinder-fb1a5b29-330c-4a4c-a870-408a14d030f1-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:12 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.960s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:12 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c 1G Apr 24 01:14:12 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:13 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c 1G" returned: 0 in 0.770s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:13 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9ae89c-3842-48b1-9281-c772c31c3799]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:13 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c Apr 24 01:14:13 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:14 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" returned: 0 in 0.790s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:14 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c Apr 24 01:14:14 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:14 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" returned: 1 in 0.677s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Downloaded image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}])) to volume 00e9a6b5-76e4-41e8-ac56-8bb42a59113c successfully. {{(pid=81925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Temporary image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 for user a3518c654890475b9ba3d4c1a9045f03 is deleted. {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Marking volume 00e9a6b5-76e4-41e8-ac56-8bb42a59113c as bootable. {{(pid=81925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Copying metadata from image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 to 00e9a6b5-76e4-41e8-ac56-8bb42a59113c. {{(pid=81925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 01:14:14 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Creating volume glance metadata for volume 00e9a6b5-76e4-41e8-ac56-8bb42a59113c backed by image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 01:14:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c665178b-5d04-492c-a77e-73e32d91e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55499ad-a853-43e7-80b5-470015ba412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:15 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Volume volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c (00e9a6b5-76e4-41e8-ac56-8bb42a59113c): created successfully Apr 24 01:14:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55499ad-a853-43e7-80b5-470015ba412e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (50012efa-1c76-4328-a6a3-8787b0723ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:15 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-8c958ce2-0afe-4d29-a57f-ab2458d01f62 tempest-VolumesGetTest-1436487431 None] Created volume successfully. Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Flow 'volume_create_manager' (eac15e08-aa47-4353-aba0-753e83988732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae590b56-75d0-48eb-bcf8-a90c2b0297b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae590b56-75d0-48eb-bcf8-a90c2b0297b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1730009078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583e5c57-265d-4849-8674-da2849d48124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b653cc3207f6486692a99e3b47e8b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:16Z,use_quota=True,user_id='37cd102eb11047d98a590875376b2f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3f238a-3418-4dee-a6af-5a2820edcd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3f238a-3418-4dee-a6af-5a2820edcd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29b7850-0e1a-4e27-9ed2-a5556b2efdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29b7850-0e1a-4e27-9ed2-a5556b2efdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583e5c57-265d-4849-8674-da2849d48124', 'volume_name': 'volume-583e5c57-265d-4849-8674-da2849d48124', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d801313f-0c2f-4a05-a7de-1f7efd8189d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d801313f-0c2f-4a05-a7de-1f7efd8189d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3195db0-5b96-4432-b3a2-3027df808763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Volume 583e5c57-265d-4849-8674-da2849d48124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583e5c57-265d-4849-8674-da2849d48124', 'volume_size': 1} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1730009078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583e5c57-265d-4849-8674-da2849d48124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b653cc3207f6486692a99e3b47e8b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:16Z,use_quota=True,user_id='37cd102eb11047d98a590875376b2f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Creating volume 583e5c57-265d-4849-8674-da2849d48124 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:16 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:16 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 1073741824 Apr 24 01:14:16 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (aa5a3ee7-99b9-4497-b631-39de0a263080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ec9526-7250-414f-8e1d-dd7ecf1140be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ec9526-7250-414f-8e1d-dd7ecf1140be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1151192809',display_name='tempest-VolumesGetTest-Volume-1303385202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc6dd32-cd58-427d-9807-78e359569d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:17Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a53a561-f447-40e3-a535-eba2dfbe7a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a53a561-f447-40e3-a535-eba2dfbe7a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54193d27-b80f-459e-8406-967b0f3a831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54193d27-b80f-459e-8406-967b0f3a831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc6dd32-cd58-427d-9807-78e359569d89', 'volume_name': 'volume-4cc6dd32-cd58-427d-9807-78e359569d89', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8250ff-29e9-40b1-a488-1cab3eb72c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8250ff-29e9-40b1-a488-1cab3eb72c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92049486-526d-46b3-9eba-361624f7c5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:16 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Volume 4cc6dd32-cd58-427d-9807-78e359569d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc6dd32-cd58-427d-9807-78e359569d89', 'volume_size': 1} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:16 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 1073741824" returned: 0 in 0.758s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:16 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 Apr 24 01:14:16 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:17 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124" returned: 0 in 0.475s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1151192809',display_name='tempest-VolumesGetTest-Volume-1303385202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc6dd32-cd58-427d-9807-78e359569d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc8d6264ff249dea15425ecc4dcb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:17Z,use_quota=True,user_id='a3518c654890475b9ba3d4c1a9045f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Creating volume 4cc6dd32-cd58-427d-9807-78e359569d89 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:17 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3195db0-5b96-4432-b3a2-3027df808763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583e5c57-265d-4849-8674-da2849d48124', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:17 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 1073741824 Apr 24 01:14:17 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4921b36c-4924-42c1-a925-04c12f7ea788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:17 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Volume volume-583e5c57-265d-4849-8674-da2849d48124 (583e5c57-265d-4849-8674-da2849d48124): created successfully Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4921b36c-4924-42c1-a925-04c12f7ea788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Flow 'volume_create_manager' (eac15e08-aa47-4353-aba0-753e83988732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:17 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e41bd7dd-f46f-48b3-a5b7-35ab8794caff tempest-ServersNegativeTestJSON-1826199753 None] Created volume successfully. Apr 24 01:14:18 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 1073741824" returned: 0 in 0.658s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:18 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 Apr 24 01:14:18 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Flow 'volume_create_manager' (6f9fa7f7-4d3d-40e0-bbbe-49c2580bc8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfc8aed-739b-4df4-8303-bceb407cb414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfc8aed-739b-4df4-8303-bceb407cb414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1381477940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf692627-b7a0-4589-b377-7dab4a87d593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79620cb96c3444f1872a532104724bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:18Z,use_quota=True,user_id='7d203d7352c549d2892ee3726edeb9df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fc4951-84d8-4fc8-bb88-08996909a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fc4951-84d8-4fc8-bb88-08996909a538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5f35b9-5309-4396-a02c-341a61fd7d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5f35b9-5309-4396-a02c-341a61fd7d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf692627-b7a0-4589-b377-7dab4a87d593', 'volume_name': 'volume-cf692627-b7a0-4589-b377-7dab4a87d593', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7365a53f-d6c0-419c-a217-03411fc4db4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7365a53f-d6c0-419c-a217-03411fc4db4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a6c38-da3a-418e-a5bd-19807c5ff8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:18 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Volume cf692627-b7a0-4589-b377-7dab4a87d593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf692627-b7a0-4589-b377-7dab4a87d593', 'volume_size': 1} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:18 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89" returned: 0 in 0.529s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.088s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1381477940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf692627-b7a0-4589-b377-7dab4a87d593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79620cb96c3444f1872a532104724bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:18Z,use_quota=True,user_id='7d203d7352c549d2892ee3726edeb9df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Creating volume cf692627-b7a0-4589-b377-7dab4a87d593 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:18 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:18 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 1073741824 Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92049486-526d-46b3-9eba-361624f7c5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc6dd32-cd58-427d-9807-78e359569d89', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:18 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d81af4-ed01-4e4e-873b-44862873480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:18 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Volume volume-4cc6dd32-cd58-427d-9807-78e359569d89 (4cc6dd32-cd58-427d-9807-78e359569d89): created successfully Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d81af4-ed01-4e4e-873b-44862873480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Flow 'volume_create_manager' (aa5a3ee7-99b9-4497-b631-39de0a263080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:18 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-17d0f73e-8265-4fe8-aee4-b5da691b8826 tempest-VolumesGetTest-1436487431 None] Created volume successfully. Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Flow 'volume_create_manager' (18d54706-4b63-4e77-a67d-376b3886ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25537909-ec83-4f6d-a893-1e526f0000c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25537909-ec83-4f6d-a893-1e526f0000c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-5689206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceadcebd-ab93-4aea-b1d8-f00d2251905e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b653cc3207f6486692a99e3b47e8b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:19Z,use_quota=True,user_id='37cd102eb11047d98a590875376b2f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90324a52-a993-4dca-a1be-7e0130dcb806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90324a52-a993-4dca-a1be-7e0130dcb806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9150ce4a-aac1-4afb-8f99-e8bbed9b98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9150ce4a-aac1-4afb-8f99-e8bbed9b98eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceadcebd-ab93-4aea-b1d8-f00d2251905e', 'volume_name': 'volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71878bc5-4216-44eb-a1f4-37fae899a09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71878bc5-4216-44eb-a1f4-37fae899a09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db1f956-7b7f-4c0a-b5af-76cde25857d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:19 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Volume ceadcebd-ab93-4aea-b1d8-f00d2251905e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e', 'volume_size': 1} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:19 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 1073741824" returned: 0 in 0.785s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:19 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 Apr 24 01:14:19 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:19 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593" returned: 0 in 0.505s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-5689206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceadcebd-ab93-4aea-b1d8-f00d2251905e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b653cc3207f6486692a99e3b47e8b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:19Z,use_quota=True,user_id='37cd102eb11047d98a590875376b2f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Creating volume ceadcebd-ab93-4aea-b1d8-f00d2251905e {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:20 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=126,cinder:SELECT=111,cinder:INSERT=39,cinder:DELETE=4 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-4cc6dd32-cd58-427d-9807-78e359569d89-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a6c38-da3a-418e-a5bd-19807c5ff8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf692627-b7a0-4589-b377-7dab4a87d593', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57189c16-28aa-4aae-b6da-8f5211089234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=139,cinder:DELETE=14,cinder:SELECT=110,cinder:INSERT=34 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:14:20 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e 1073741824 Apr 24 01:14:20 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Lock "cinder-4cc6dd32-cd58-427d-9807-78e359569d89-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:20 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Volume volume-cf692627-b7a0-4589-b377-7dab4a87d593 (cf692627-b7a0-4589-b377-7dab4a87d593): created successfully Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57189c16-28aa-4aae-b6da-8f5211089234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Flow 'volume_create_manager' (6f9fa7f7-4d3d-40e0-bbbe-49c2580bc8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:20 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-22f62815-5412-464a-bc92-49292a440436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Created volume successfully. Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-4cc6dd32-cd58-427d-9807-78e359569d89" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-4cc6dd32-cd58-427d-9807-78e359569d89" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a2fa90-902f-444b-b0b2-e30c3f9cf363]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:20 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 Apr 24 01:14:20 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:20 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e 1073741824" returned: 0 in 0.792s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:20 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89" returned: 0 in 0.643s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:20 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89 Apr 24 01:14:20 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:20 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e Apr 24 01:14:20 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:21 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e" returned: 0 in 0.434s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:21 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.426s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db1f956-7b7f-4c0a-b5af-76cde25857d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed9641a-11e2-41ff-871a-8083b84a2009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4cc6dd32-cd58-427d-9807-78e359569d89" returned: 0 in 0.494s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-4cc6dd32-cd58-427d-9807-78e359569d89" released by "delete_volume" :: held 1.184s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Creating offline snapshot 7791fca3-d1be-4f01-9d79-8a1d3f348f4c of volume cf692627-b7a0-4589-b377-7dab4a87d593 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af258eb-09e1-40e3-b2e9-8a13de9df1b8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:21 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Volume volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e (ceadcebd-ab93-4aea-b1d8-f00d2251905e): created successfully Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed9641a-11e2-41ff-871a-8083b84a2009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Flow 'volume_create_manager' (18d54706-4b63-4e77-a67d-376b3886ca65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0ea2f916-de75-41d6-a3b6-7f72fc7cee09 tempest-ServersNegativeTestJSON-1826199753 None] Created volume successfully. Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Created reservations ['9bcef3d2-45e1-42e7-a41a-eadf790d0c14', '3efed62d-a7f9-4f0d-ab3e-7e7c46c0fdd9', '8c77cba5-5229-451a-bfb8-e4b6e5fe66a9', '7af9e510-5d5d-4135-b7b8-b381b03bb937'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:21 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 Apr 24 01:14:21 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:21 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:21 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "cinder-ceadcebd-ab93-4aea-b1d8-f00d2251905e-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Lock "cinder-ceadcebd-ab93-4aea-b1d8-f00d2251905e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "cinder-quobyte-ceadcebd-ab93-4aea-b1d8-f00d2251905e" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Lock "cinder-quobyte-ceadcebd-ab93-4aea-b1d8-f00d2251905e" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e09870-56e6-4108-8c80-8d13a5a10101]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:22 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593" returned: 0 in 0.647s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:22 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e Apr 24 01:14:22 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:22 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:22 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c 1G Apr 24 01:14:22 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Deleted volume successfully. Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-88f4eb4a-a0e9-4914-a3df-2f7caa231759 tempest-VolumesGetTest-1436487431 None] Lock "cinder-4cc6dd32-cd58-427d-9807-78e359569d89-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-00e9a6b5-76e4-41e8-ac56-8bb42a59113c-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Lock "cinder-00e9a6b5-76e4-41e8-ac56-8bb42a59113c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Acquiring lock "cinder-quobyte-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" acquired by "delete_volume" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4867f875-06f2-4e8d-8d98-84c2ffcd92d1]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:22 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e" returned: 0 in 0.604s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:22 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c Apr 24 01:14:22 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:22 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e Apr 24 01:14:22 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:22 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c 1G" returned: 0 in 0.744s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf692627-b7a0-4589-b377-7dab4a87d593 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:22 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf692627-b7a0-4589-b377-7dab4a87d593 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c Apr 24 01:14:22 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:23 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ceadcebd-ab93-4aea-b1d8-f00d2251905e" returned: 0 in 0.499s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:23 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" returned: 0 in 0.563s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Lock "cinder-quobyte-ceadcebd-ab93-4aea-b1d8-f00d2251905e" released by "delete_volume" :: held 1.155s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Created reservations ['02ec07ef-3374-40cb-8de0-8c6e7d5e09ac', '09c8d674-b65a-4f37-a833-0abaa05cb0c8', '7e4bc0cc-02d2-406c-ad7d-eb914677577b', 'cfd21f40-079f-4bd1-9afa-2cd6465fd536'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:23 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c Apr 24 01:14:23 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:23 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:23 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:23 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf692627-b7a0-4589-b377-7dab4a87d593 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c" returned: 0 in 0.549s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:23 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c is being set with open permissions: ugo+rw Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:23 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c Apr 24 01:14:23 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:23 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" returned: 1 in 0.591s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:23 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c Apr 24 01:14:23 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:23 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.496s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:23 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Deleted volume successfully. Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-497d6cf4-ac68-47a9-a4f6-8c82a5123bbe tempest-ServersNegativeTestJSON-1826199753 None] Lock "cinder-ceadcebd-ab93-4aea-b1d8-f00d2251905e-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:23 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c" returned: 0 in 0.474s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:23 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.info Apr 24 01:14:23 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "cinder-583e5c57-265d-4849-8674-da2849d48124-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Lock "cinder-583e5c57-265d-4849-8674-da2849d48124-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "cinder-quobyte-583e5c57-265d-4849-8674-da2849d48124" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:24 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Lock "cinder-quobyte-583e5c57-265d-4849-8674-da2849d48124" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" returned: 0 in 0.539s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0760f8-48ce-4c27-9b37-bbb17c2b5520]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Lock "cinder-quobyte-00e9a6b5-76e4-41e8-ac56-8bb42a59113c" released by "delete_volume" :: held 1.763s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Created reservations ['26bb2258-187f-4d4c-9619-414179acb77b', '0953c3bb-ef35-46d4-b734-91652fe1dd39', '1d28037b-c884-4ff7-a656-e11a1f8a123c', '9bfb1eb4-9e56-4599-b88c-ff1de26ed028'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:24 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 Apr 24 01:14:24 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:24 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:24 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:24 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.info" returned: 0 in 0.572s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:24 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.info is being set with open permissions: ugo+rw Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:24 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.info Apr 24 01:14:24 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:24 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124" returned: 0 in 0.606s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:24 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124 Apr 24 01:14:24 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:24 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.info" returned: 0 in 0.559s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.685s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:24 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.635s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:25 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Deleted volume successfully. Apr 24 01:14:25 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1ea7818c-20b6-4732-a58d-52d7112bba79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Create snapshot completed successfully Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-26bd5449-8464-47fa-a52c-1192ebe4a13c tempest-VolumesGetTest-1436487431 None] Lock "cinder-00e9a6b5-76e4-41e8-ac56-8bb42a59113c-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:25 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-583e5c57-265d-4849-8674-da2849d48124" returned: 0 in 0.539s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Lock "cinder-quobyte-583e5c57-265d-4849-8674-da2849d48124" released by "delete_volume" :: held 1.188s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Created reservations ['fa4c8590-7d98-41d0-b045-d55a9a6313ae', 'eeee69fa-55bf-4c7a-8243-83518b2db15d', 'b68c85a7-37de-4855-80b2-28fa966c96f3', '3142d64d-8f10-411d-8d43-75c90ea2531e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:25 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:25 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:26 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:26 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Deleted volume successfully. Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-06689b98-a028-4128-a42a-5d2da99e2e71 tempest-ServersNegativeTestJSON-1826199753 None] Lock "cinder-583e5c57-265d-4849-8674-da2849d48124-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "cinder-7791fca3-d1be-4f01-9d79-8a1d3f348f4c-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-7791fca3-d1be-4f01-9d79-8a1d3f348f4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "cinder-quobyte-cf692627-b7a0-4589-b377-7dab4a87d593" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-quobyte-cf692627-b7a0-4589-b377-7dab4a87d593" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "cinder-quobyte-7791fca3-d1be-4f01-9d79-8a1d3f348f4c" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-quobyte-7791fca3-d1be-4f01-9d79-8a1d3f348f4c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Deleting offline snapshot 7791fca3-d1be-4f01-9d79-8a1d3f348f4c of volume cf692627-b7a0-4589-b377-7dab4a87d593 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] snapshot_file for this snap is: volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[00550f0a-c07e-451a-a2c9-97a9107b9704]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:26 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c Apr 24 01:14:26 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:27 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c" returned: 0 in 0.617s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf692627-b7a0-4589-b377-7dab4a87d593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:14:27 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6672220-c730-46f8-b3cb-11d8b57611ce]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:27 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 Apr 24 01:14:27 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:27 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593" returned: 0 in 0.628s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:27 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c Apr 24 01:14:27 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:28 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c" returned: 0 in 0.767s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:28 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c Apr 24 01:14:28 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:29 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593.7791fca3-d1be-4f01-9d79-8a1d3f348f4c" returned: 0 in 0.516s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-quobyte-7791fca3-d1be-4f01-9d79-8a1d3f348f4c" released by "_delete_snapshot" :: held 2.662s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-quobyte-cf692627-b7a0-4589-b377-7dab4a87d593" released by "delete_snapshot" :: held 2.687s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Created reservations ['5c289b46-fc15-4773-90e5-58b460ba96c4', 'e239e2cc-232a-47f5-9409-4bdea462897b', '36378217-c574-4992-bcf6-d5793f5fafa1', '3a1fe379-6f9b-49fe-b47a-450fd8cc76b8'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Delete snapshot completed successfully. Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a67a3789-f06d-447f-ab5a-800cd875ecca tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-7791fca3-d1be-4f01-9d79-8a1d3f348f4c-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "cinder-cf692627-b7a0-4589-b377-7dab4a87d593-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-cf692627-b7a0-4589-b377-7dab4a87d593-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "cinder-quobyte-cf692627-b7a0-4589-b377-7dab4a87d593" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-quobyte-cf692627-b7a0-4589-b377-7dab4a87d593" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d47a3-43c8-4021-bac8-d1f3319f80d6]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:30 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 Apr 24 01:14:30 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:30 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593" returned: 0 in 0.603s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:30 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593 Apr 24 01:14:30 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:31 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-cf692627-b7a0-4589-b377-7dab4a87d593" returned: 0 in 0.539s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-quobyte-cf692627-b7a0-4589-b377-7dab4a87d593" released by "delete_volume" :: held 1.210s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Created reservations ['4b650cdf-da4b-4086-84ac-461d1875ef4c', '359942fc-f221-419f-a963-0872accfb210', '1e8f324d-8b3f-40cd-8e68-cc5cee2516fd', 'cf71d909-0dda-48ad-9264-bb941208c846'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:31 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:14:31 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:31 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.455s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:14:31 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Deleted volume successfully. Apr 24 01:14:31 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-cd5c8bcc-0910-4d52-97d1-94175762bf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636507856 None] Lock "cinder-cf692627-b7a0-4589-b377-7dab4a87d593-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (1f3e7554-1ae7-423f-ae58-ad2a62fe789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d12fc2-7a7d-4e25-ad60-844d782eaaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d12fc2-7a7d-4e25-ad60-844d782eaaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2097478466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee87d18-414a-48e2-b8d4-5b8fe165eb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffc7d1deea3440d85e8d471ee4dc343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:39Z,use_quota=True,user_id='00362f54fa9f40ec82aba21834a1b997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35214d78-3c7d-4193-9b63-6e95d15a54c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35214d78-3c7d-4193-9b63-6e95d15a54c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757a822f-9611-4923-8668-611a2afe19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757a822f-9611-4923-8668-611a2afe19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee87d18-414a-48e2-b8d4-5b8fe165eb72', 'volume_name': 'volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e191b43e-4132-4745-99ab-81750d96588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e191b43e-4132-4745-99ab-81750d96588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffabd88-7030-4ee4-ac5b-ca33925502e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:38 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Volume 4ee87d18-414a-48e2-b8d4-5b8fe165eb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72', 'volume_size': 1} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2097478466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee87d18-414a-48e2-b8d4-5b8fe165eb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffc7d1deea3440d85e8d471ee4dc343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:39Z,use_quota=True,user_id='00362f54fa9f40ec82aba21834a1b997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Creating volume 4ee87d18-414a-48e2-b8d4-5b8fe165eb72 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:38 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:38 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 1073741824 Apr 24 01:14:38 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:39 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 1073741824" returned: 0 in 0.803s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:39 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 Apr 24 01:14:39 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:40 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" returned: 0 in 0.561s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffabd88-7030-4ee4-ac5b-ca33925502e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9945ed5-554e-4903-a0a3-9fc19964e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:40 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Volume volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 (4ee87d18-414a-48e2-b8d4-5b8fe165eb72): created successfully Apr 24 01:14:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9945ed5-554e-4903-a0a3-9fc19964e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (1f3e7554-1ae7-423f-ae58-ad2a62fe789c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2ebf18ce-df09-48e7-9180-188b551ae98d tempest-VolumesSnapshotTestJSON-2142202378 None] Created volume successfully. Apr 24 01:14:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Creating offline snapshot 83c641db-0848-4f3e-ba2d-e2a605b9a994 of volume 4ee87d18-414a-48e2-b8d4-5b8fe165eb72 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:14:41 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[99841fda-a369-4d27-9db2-381f1900fac4]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:41 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 Apr 24 01:14:41 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:41 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" returned: 0 in 0.688s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:42 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 1G Apr 24 01:14:42 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:42 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 1G" returned: 0 in 0.832s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:42 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 Apr 24 01:14:42 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:43 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994" returned: 0 in 0.643s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:43 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 is being set with open permissions: ugo+rw Apr 24 01:14:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:43 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 Apr 24 01:14:43 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:44 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994" returned: 0 in 0.631s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:44 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.info Apr 24 01:14:44 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:44 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.info" returned: 0 in 0.639s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:44 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.info is being set with open permissions: ugo+rw Apr 24 01:14:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:44 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.info Apr 24 01:14:44 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:45 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.info" returned: 0 in 0.683s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.240s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:45 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-cc407e9d-7249-499e-8c35-32805bc7a3cf tempest-VolumesSnapshotTestJSON-2142202378 None] Create snapshot completed successfully Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-83c641db-0848-4f3e-ba2d-e2a605b9a994-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-83c641db-0848-4f3e-ba2d-e2a605b9a994-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-83c641db-0848-4f3e-ba2d-e2a605b9a994" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-83c641db-0848-4f3e-ba2d-e2a605b9a994" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Deleting offline snapshot 83c641db-0848-4f3e-ba2d-e2a605b9a994 of volume 4ee87d18-414a-48e2-b8d4-5b8fe165eb72 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] snapshot_file for this snap is: volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[16af80d2-7b22-4744-b090-a89aafedbc29]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:46 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 Apr 24 01:14:46 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:47 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994" returned: 0 in 0.632s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:14:47 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca465ad-4ca6-4fe4-a639-3a82c8620271]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:47 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 Apr 24 01:14:47 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:48 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" returned: 0 in 0.670s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:48 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 Apr 24 01:14:48 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:48 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:14:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Flow 'volume_create_manager' (32369ecc-04ff-4a07-8c2d-6dc551ad826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f593fbb-1489-42e8-9aa1-a329090eebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f593fbb-1489-42e8-9aa1-a329090eebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1715046148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f49147-c0ec-4bac-847c-bb4ef674a02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466fb005efdd4b719a05f17a20e865c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:49Z,use_quota=True,user_id='4e66626436dc454da010ce4cd769ff4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fba2685-a449-41fc-80fb-538730ca01bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fba2685-a449-41fc-80fb-538730ca01bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6da41b-6318-4a0d-829e-a137376a6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:49 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6da41b-6318-4a0d-829e-a137376a6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f49147-c0ec-4bac-847c-bb4ef674a02f', 'volume_name': 'volume-53f49147-c0ec-4bac-847c-bb4ef674a02f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c83fa0-1ca3-4b01-a3d2-c71416c0c802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c83fa0-1ca3-4b01-a3d2-c71416c0c802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f43ef7-b195-4e1e-9a10-90428025a7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:49 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Volume 53f49147-c0ec-4bac-847c-bb4ef674a02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f49147-c0ec-4bac-847c-bb4ef674a02f', 'volume_size': 1} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1715046148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f49147-c0ec-4bac-847c-bb4ef674a02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466fb005efdd4b719a05f17a20e865c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:49Z,use_quota=True,user_id='4e66626436dc454da010ce4cd769ff4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Creating volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:49 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994" returned: 0 in 0.893s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:49 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f 1073741824 Apr 24 01:14:49 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:49 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994 Apr 24 01:14:49 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:49 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72.83c641db-0848-4f3e-ba2d-e2a605b9a994" returned: 0 in 0.573s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-83c641db-0848-4f3e-ba2d-e2a605b9a994" released by "_delete_snapshot" :: held 2.918s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" released by "delete_snapshot" :: held 2.945s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Created reservations ['fcccba59-5ad3-42cd-b4d1-5c845fae2e19', 'de1def6e-32ca-4257-8535-a7bb25c15585', '9e8c27a5-f568-44fa-a3ab-c5cefc3a14e9', '6d910266-e080-4a8b-b234-51f601e72803'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:14:49 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Delete snapshot completed successfully. Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3a44aba6-2b56-4e9e-a31c-9413556a48ca tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-83c641db-0848-4f3e-ba2d-e2a605b9a994-delete_snapshot" released by "delete_snapshot" :: held 3.169s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:14:49 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f 1073741824" returned: 0 in 0.836s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:49 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f Apr 24 01:14:49 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:14:50 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (ecd89a7e-e2f6-4d17-b133-584292aa3662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9214b00b-92e5-4c61-b08f-3cf01f07f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f" returned: 0 in 0.595s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9214b00b-92e5-4c61-b08f-3cf01f07f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-421005808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e5fb61-84f9-4fe9-936a-51d231483986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffc7d1deea3440d85e8d471ee4dc343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:50Z,use_quota=True,user_id='00362f54fa9f40ec82aba21834a1b997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c1028a-76a7-4815-83e1-26eb24bb83b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c1028a-76a7-4815-83e1-26eb24bb83b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67568310-de2e-4e95-8df2-062ef171a49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67568310-de2e-4e95-8df2-062ef171a49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e5fb61-84f9-4fe9-936a-51d231483986', 'volume_name': 'volume-a6e5fb61-84f9-4fe9-936a-51d231483986', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9441a6-7eb7-42b0-92b7-a220a0e3fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9441a6-7eb7-42b0-92b7-a220a0e3fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a8afc6-fd07-4f49-a568-50b00d327e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:50 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Volume a6e5fb61-84f9-4fe9-936a-51d231483986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e5fb61-84f9-4fe9-936a-51d231483986', 'volume_size': 1} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-421005808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e5fb61-84f9-4fe9-936a-51d231483986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffc7d1deea3440d85e8d471ee4dc343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:14:50Z,use_quota=True,user_id='00362f54fa9f40ec82aba21834a1b997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Creating volume a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:14:50 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f43ef7-b195-4e1e-9a10-90428025a7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f49147-c0ec-4bac-847c-bb4ef674a02f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92431878-d8f9-4fcd-977d-e3c9922d8403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:50 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 1073741824 Apr 24 01:14:50 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:50 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Volume volume-53f49147-c0ec-4bac-847c-bb4ef674a02f (53f49147-c0ec-4bac-847c-bb4ef674a02f): created successfully Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92431878-d8f9-4fcd-977d-e3c9922d8403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Flow 'volume_create_manager' (32369ecc-04ff-4a07-8c2d-6dc551ad826e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:50 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-730e4ee4-1d01-47f5-99b5-d864cd161357 tempest-SnapshotsActionsTest-1412139356 None] Created volume successfully. Apr 24 01:14:51 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 1073741824" returned: 0 in 0.722s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:51 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 Apr 24 01:14:51 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:51 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986" returned: 0 in 0.473s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.449s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Creating offline snapshot d536dd1f-9f85-40fc-a5ef-514591f594b1 of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a8afc6-fd07-4f49-a568-50b00d327e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e5fb61-84f9-4fe9-936a-51d231483986', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53866dd9-c517-4c7e-a773-9eec022564d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad5b53b-f369-4552-9f82-497beae571f2]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:51 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Volume volume-a6e5fb61-84f9-4fe9-936a-51d231483986 (a6e5fb61-84f9-4fe9-936a-51d231483986): created successfully Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53866dd9-c517-4c7e-a773-9eec022564d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:14:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (ecd89a7e-e2f6-4d17-b133-584292aa3662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:14:52 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-6c6ef89e-d412-41b0-86c6-5308ccc6bcbf tempest-VolumesSnapshotTestJSON-2142202378 None] Created volume successfully. Apr 24 01:14:52 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f Apr 24 01:14:52 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:52 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f" returned: 0 in 0.730s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:52 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 1G Apr 24 01:14:52 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:53 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 1G" returned: 0 in 0.708s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:53 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:14:53 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:53 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.521s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:53 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 is being set with open permissions: ugo+rw Apr 24 01:14:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:53 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:14:53 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:54 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:54 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.info Apr 24 01:14:54 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:54 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.info" returned: 0 in 0.510s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:54 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.info is being set with open permissions: ugo+rw Apr 24 01:14:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:54 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.info Apr 24 01:14:54 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:55 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.info" returned: 0 in 0.513s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.626s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.675s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Creating offline snapshot 7f59dfcd-628b-409f-b26d-ea7bb622765f of volume a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:14:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-af70fa31-72ab-47d6-b007-204f917b3778 tempest-SnapshotsActionsTest-1412139356 None] Create snapshot completed successfully Apr 24 01:14:55 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7ec39-a66b-4cbd-9001-2ddc09cca435]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:55 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 Apr 24 01:14:55 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:56 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986" returned: 0 in 0.576s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:56 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f 1G Apr 24 01:14:56 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:56 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f 1G" returned: 0 in 0.833s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e5fb61-84f9-4fe9-936a-51d231483986 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:56 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e5fb61-84f9-4fe9-936a-51d231483986 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f Apr 24 01:14:56 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:14:57 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e5fb61-84f9-4fe9-936a-51d231483986 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f" returned: 0 in 0.615s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:57 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f is being set with open permissions: ugo+rw Apr 24 01:14:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:57 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f Apr 24 01:14:57 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:58 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f" returned: 0 in 0.472s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:58 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.info Apr 24 01:14:58 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:58 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.info" returned: 0 in 0.521s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:58 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.info is being set with open permissions: ugo+rw Apr 24 01:14:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:58 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.info Apr 24 01:14:58 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:59 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.info" returned: 0 in 0.491s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.604s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.745s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Creating offline snapshot acd634b5-dc49-4273-8a29-375e91f830db of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:14:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1fe9e52b-7bf9-4894-ac5c-b5ba504ec060 tempest-VolumesSnapshotTestJSON-2142202378 None] Create snapshot completed successfully Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1961f84-1188-4ef2-a196-8a0f7baa18b1]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:59 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:14:59 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:14:59 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.540s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:14:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:14:59 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db 1G Apr 24 01:14:59 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:15:00 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db 1G" returned: 0 in 0.801s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:00 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db Apr 24 01:15:00 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (a834597d-9c03-4713-aecf-7335b75c7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d12a83d-bb11-4c7a-a6d1-3bca33a98f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d12a83d-bb11-4c7a-a6d1-3bca33a98f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-47374399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b73aa65-dfe4-4aeb-ad92-e921042bb48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffc7d1deea3440d85e8d471ee4dc343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7f59dfcd-628b-409f-b26d-ea7bb622765f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:01Z,use_quota=True,user_id='00362f54fa9f40ec82aba21834a1b997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634cd60d-120e-4cb1-bb3b-695889b4e797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634cd60d-120e-4cb1-bb3b-695889b4e797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6720ba4-38c7-4d5e-8fd6-82d9049ef428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6720ba4-38c7-4d5e-8fd6-82d9049ef428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b73aa65-dfe4-4aeb-ad92-e921042bb48e', 'volume_name': 'volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e', 'volume_size': 2, 'snapshot_id': '7f59dfcd-628b-409f-b26d-ea7bb622765f'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046eb005-187d-4185-b506-8fc3a08f9760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046eb005-187d-4185-b506-8fc3a08f9760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf09be7-e213-4cd7-b90b-3549038afac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:00 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Volume 2b73aa65-dfe4-4aeb-ad92-e921042bb48e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e', 'volume_size': 2, 'snapshot_id': '7f59dfcd-628b-409f-b26d-ea7bb622765f'} Apr 24 01:15:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:01 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:01 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db is being set with open permissions: ugo+rw Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:01 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db Apr 24 01:15:01 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:01 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.934s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-7f59dfcd-628b-409f-b26d-ea7bb622765f-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" by "_create_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-7f59dfcd-628b-409f-b26d-ea7bb622765f-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Creating volume 2b73aa65-dfe4-4aeb-ad92-e921042bb48e from snapshot 7f59dfcd-628b-409f-b26d-ea7bb622765f {{(pid=81925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:01 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4aec70c4-88f3-4e0c-ba35-6d53d994bffb tempest-SnapshotsActionsTest-1412139356 None] Create snapshot completed successfully Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] snapshot: 7f59dfcd-628b-409f-b26d-ea7bb622765f, volume: 2b73aa65-dfe4-4aeb-ad92-e921042bb48e, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[840d0361-4735-4270-81b0-c98ccb7f72cc]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:01 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f Apr 24 01:15:01 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:02 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f" returned: 0 in 0.617s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6e5fb61-84f9-4fe9-936a-51d231483986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ccf62f-c3ce-4402-9b07-c57179d1a464]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:02 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 Apr 24 01:15:02 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-acd634b5-dc49-4273-8a29-375e91f830db-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-acd634b5-dc49-4273-8a29-375e91f830db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-quobyte-acd634b5-dc49-4273-8a29-375e91f830db" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-acd634b5-dc49-4273-8a29-375e91f830db" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Deleting offline snapshot acd634b5-dc49-4273-8a29-375e91f830db of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] snapshot_file for this snap is: volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccaff42-d9dd-4271-a0b6-dd1d738f8b4a]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:02 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db Apr 24 01:15:02 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:03 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986" returned: 0 in 0.605s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:03 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:15:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:03 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e Apr 24 01:15:03 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:03 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db" returned: 0 in 0.611s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:03 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848b8ac-5b7d-4d34-8528-f7968a9c8128]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:03 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:03 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:04 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 1.500s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:04 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:05 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db Apr 24 01:15:05 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:06 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db" returned: 0 in 1.604s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:06 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db Apr 24 01:15:06 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:07 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.acd634b5-dc49-4273-8a29-375e91f830db" returned: 0 in 1.217s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-acd634b5-dc49-4273-8a29-375e91f830db" released by "_delete_snapshot" :: held 5.085s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" released by "delete_snapshot" :: held 5.121s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:08 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Created reservations ['e1062af8-842f-4bd9-be5c-8a2501c5691a', '029ec0c1-06a2-4aad-956c-d87095a7ac63', 'a3c66cf4-9e07-42d3-802f-29723745c754', '8801f446-a314-4f92-a35a-972a9481d3f2'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:08 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Delete snapshot completed successfully. Apr 24 01:15:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-311dac92-e6e7-4a7d-8528-d7bad252fca2 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-acd634b5-dc49-4273-8a29-375e91f830db-delete_snapshot" released by "delete_snapshot" :: held 5.372s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:09 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" returned: 0 in 5.969s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad20fe-ce0e-45e8-855e-f68b8c2c8eca]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:09 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 Apr 24 01:15:09 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:09 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986" returned: 0 in 0.724s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:09 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:15:09 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Converted 1024.00 MB image at 171.49 MB/s Apr 24 01:15:09 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e is being set with open permissions: ugo+rw Apr 24 01:15:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:09 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e Apr 24 01:15:09 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:10 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" returned: 0 in 0.442s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" released by "_copy_volume_from_snapshot" :: held 8.479s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-7f59dfcd-628b-409f-b26d-ea7bb622765f-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" released by "_create_volume_from_snapshot" :: held 8.518s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.547s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.284s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Creating offline snapshot 995b291a-ef35-41db-b480-61512997e1c7 of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf09be7-e213-4cd7-b90b-3549038afac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e', 'volume_size': 2, 'snapshot_id': '7f59dfcd-628b-409f-b26d-ea7bb622765f'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be7ee30-07a0-4b40-9abf-ab2ba53cba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[306b058e-1d7b-4b45-8050-3726a847bd70]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:10 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Volume volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e (2b73aa65-dfe4-4aeb-ad92-e921042bb48e): created successfully Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be7ee30-07a0-4b40-9abf-ab2ba53cba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (a834597d-9c03-4713-aecf-7335b75c7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:10 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5ed6f02b-3a02-4ec1-a897-b8ef44647776 tempest-VolumesSnapshotTestJSON-2142202378 None] Created volume successfully. Apr 24 01:15:10 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:10 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-2b73aa65-dfe4-4aeb-ad92-e921042bb48e-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-2b73aa65-dfe4-4aeb-ad92-e921042bb48e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f98810-304e-4ccf-8b36-de72ac9ca9a6]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:11 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e Apr 24 01:15:11 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:11 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.723s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:11 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 1G Apr 24 01:15:11 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:11 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" returned: 0 in 0.612s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:11 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e Apr 24 01:15:11 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:11 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 1G" returned: 0 in 0.688s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:11 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 Apr 24 01:15:11 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:11 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:11 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:12 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" returned: 0 in 0.597s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-2b73aa65-dfe4-4aeb-ad92-e921042bb48e" released by "delete_volume" :: held 1.264s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Created reservations ['ab9c71ae-58b0-4b2a-9fea-b1708831c07f', '565972ec-838f-4c2f-ad04-9e41038c892b', '9f44b473-1403-412b-9554-4bc298b99724', 'a62b9977-3c6e-412f-ba09-100f4b777cc8'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:12 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:12 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:12 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7" returned: 0 in 0.728s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:12 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 is being set with open permissions: ugo+rw Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:12 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.684s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:12 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 Apr 24 01:15:12 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:12 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.534s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:12 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Deleted volume successfully. Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c08efcee-d04e-4636-9574-39b118aa7b8f tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-2b73aa65-dfe4-4aeb-ad92-e921042bb48e-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:12 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7" returned: 0 in 0.515s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.810s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-7f59dfcd-628b-409f-b26d-ea7bb622765f-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-7f59dfcd-628b-409f-b26d-ea7bb622765f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-a6e5fb61-84f9-4fe9-936a-51d231483986" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:13 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e9cf977b-96c3-4e4d-abe9-fb279f111730 tempest-SnapshotsActionsTest-1412139356 None] Create snapshot completed successfully Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-a6e5fb61-84f9-4fe9-936a-51d231483986" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-7f59dfcd-628b-409f-b26d-ea7bb622765f" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-7f59dfcd-628b-409f-b26d-ea7bb622765f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Deleting offline snapshot 7f59dfcd-628b-409f-b26d-ea7bb622765f of volume a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] snapshot_file for this snap is: volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef451b9c-eac6-4c7c-9147-b305d6c936fc]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:13 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f Apr 24 01:15:13 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:13 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f" returned: 0 in 0.731s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6e5fb61-84f9-4fe9-936a-51d231483986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bcf3fa-04d8-4b5b-8407-a189e53f3c78]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:14 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 Apr 24 01:15:14 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-995b291a-ef35-41db-b480-61512997e1c7-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-995b291a-ef35-41db-b480-61512997e1c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-quobyte-995b291a-ef35-41db-b480-61512997e1c7" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-995b291a-ef35-41db-b480-61512997e1c7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Deleting offline snapshot 995b291a-ef35-41db-b480-61512997e1c7 of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] snapshot_file for this snap is: volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c455beeb-e108-4c00-90e1-ea3e2031615d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:14 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 Apr 24 01:15:14 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:14 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986" returned: 0 in 0.679s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:14 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f Apr 24 01:15:14 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:15 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7" returned: 0 in 0.604s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e856cedb-9532-4072-879b-888ac5b74347]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:15 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:15 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:15 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f" returned: 0 in 0.721s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:15 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f Apr 24 01:15:15 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:15 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.543s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:15 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 Apr 24 01:15:15 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:15 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986.7f59dfcd-628b-409f-b26d-ea7bb622765f" returned: 0 in 0.648s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-7f59dfcd-628b-409f-b26d-ea7bb622765f" released by "_delete_snapshot" :: held 2.918s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-a6e5fb61-84f9-4fe9-936a-51d231483986" released by "delete_snapshot" :: held 2.943s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Created reservations ['85860d19-dc7b-49fc-85f0-3dd629734f26', 'f6de188f-7ae0-43cb-8463-e6f0f498464a', '94788223-f34d-416d-946b-8823c1f55c0c', 'a38977c2-fec3-44d1-ad38-9fd0af2f6f2e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:16 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Delete snapshot completed successfully. Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e09e625e-e08d-4f44-a0e0-ba2f1bcd474a tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-7f59dfcd-628b-409f-b26d-ea7bb622765f-delete_snapshot" released by "delete_snapshot" :: held 3.123s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-a6e5fb61-84f9-4fe9-936a-51d231483986-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-a6e5fb61-84f9-4fe9-936a-51d231483986-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-a6e5fb61-84f9-4fe9-936a-51d231483986" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-a6e5fb61-84f9-4fe9-936a-51d231483986" acquired by "delete_volume" :: waited 0.027s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b83ec6-0314-42c9-bfb5-aa9b5764f342]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:16 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7" returned: 0 in 0.978s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:16 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7 Apr 24 01:15:16 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:16 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 Apr 24 01:15:16 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:17 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986" returned: 0 in 0.520s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:17 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.995b291a-ef35-41db-b480-61512997e1c7" returned: 0 in 0.518s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:17 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986 Apr 24 01:15:17 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-995b291a-ef35-41db-b480-61512997e1c7" released by "_delete_snapshot" :: held 2.775s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" released by "delete_snapshot" :: held 2.802s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Created reservations ['7547c140-ee7b-4677-aa54-d828e184f9ae', '9f151e26-de97-4b15-ae09-dd8a0470162a', '5d39fdab-4428-43ed-a0ad-a1aaca8d7a14', 'f7805459-2917-4e75-8bc1-4c02bdad6dbc'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:17 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Delete snapshot completed successfully. Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-99156910-4f47-41ea-a5f9-23e57c1f73e0 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-995b291a-ef35-41db-b480-61512997e1c7-delete_snapshot" released by "delete_snapshot" :: held 3.005s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:17 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a6e5fb61-84f9-4fe9-936a-51d231483986" returned: 0 in 0.486s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-a6e5fb61-84f9-4fe9-936a-51d231483986" released by "delete_volume" :: held 1.069s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Created reservations ['401ba27c-6958-4ac7-a24a-b382bfa1188c', 'cad26ca8-3d66-483a-b0ce-c140980a4280', 'a66e1b06-fde2-4706-a938-40907f38c421', '1b6a6ae2-0ed7-45d0-9988-d252efa7e12d'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:17 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:17 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Creating offline snapshot 54fd2d7d-16fa-49ed-b458-370fafb27209 of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a97f9d-fe40-414d-9c39-8f4cd91cddbf]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:18 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:18 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:18 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.516s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:18 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:18 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Deleted volume successfully. Apr 24 01:15:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e28155f2-59fe-468e-8554-bfd99ef4fdfa tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-a6e5fb61-84f9-4fe9-936a-51d231483986-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:18 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.583s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:18 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 1G Apr 24 01:15:18 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (a8c2bc10-1452-4e45-b7e5-f997306730ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123b88d7-abde-4e98-a838-f21b7358b394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123b88d7-abde-4e98-a838-f21b7358b394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-102386152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32780c39-0c30-4c63-80da-0c9b862f883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffc7d1deea3440d85e8d471ee4dc343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:19Z,use_quota=True,user_id='00362f54fa9f40ec82aba21834a1b997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a13e47e-9c2b-4e3c-b8cd-73b4ed96dd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a13e47e-9c2b-4e3c-b8cd-73b4ed96dd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b0bca6-e408-4689-ab79-7dca7af3133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b0bca6-e408-4689-ab79-7dca7af3133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32780c39-0c30-4c63-80da-0c9b862f883b', 'volume_name': 'volume-32780c39-0c30-4c63-80da-0c9b862f883b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d169894f-ad6c-44b4-9fc0-fa5425236557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d169894f-ad6c-44b4-9fc0-fa5425236557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847cbad9-dabf-4a9c-bd5e-791eed88cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:19 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Volume 32780c39-0c30-4c63-80da-0c9b862f883b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32780c39-0c30-4c63-80da-0c9b862f883b', 'volume_size': 1} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:19 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 1G" returned: 0 in 0.751s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:19 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 Apr 24 01:15:19 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:19 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209" returned: 0 in 0.525s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:19 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 is being set with open permissions: ugo+rw Apr 24 01:15:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:19 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 Apr 24 01:15:19 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:20 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209" returned: 0 in 0.445s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=113,cinder:UPDATE=119,cinder:DELETE=10,cinder:INSERT=36 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=96,cinder:SELECT=84,cinder:INSERT=20,cinder:DELETE=9 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.115s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-102386152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32780c39-0c30-4c63-80da-0c9b862f883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffc7d1deea3440d85e8d471ee4dc343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:19Z,use_quota=True,user_id='00362f54fa9f40ec82aba21834a1b997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Creating volume 32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:15:20 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:20 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b 1073741824 Apr 24 01:15:20 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:20 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-511a58f1-0e43-4b3b-9a9f-2d73dca40997 tempest-SnapshotsActionsTest-1412139356 None] Create snapshot completed successfully Apr 24 01:15:20 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b 1073741824" returned: 0 in 0.631s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:21 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b Apr 24 01:15:21 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-54fd2d7d-16fa-49ed-b458-370fafb27209-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-54fd2d7d-16fa-49ed-b458-370fafb27209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-quobyte-54fd2d7d-16fa-49ed-b458-370fafb27209" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-54fd2d7d-16fa-49ed-b458-370fafb27209" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Deleting offline snapshot 54fd2d7d-16fa-49ed-b458-370fafb27209 of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] snapshot_file for this snap is: volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae0e5c1-9b2e-460e-83a1-59211420b447]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:21 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 Apr 24 01:15:21 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:21 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b" returned: 0 in 0.514s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847cbad9-dabf-4a9c-bd5e-791eed88cb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32780c39-0c30-4c63-80da-0c9b862f883b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480131df-d872-4545-8d83-9ef4e3cb11d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:21 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Volume volume-32780c39-0c30-4c63-80da-0c9b862f883b (32780c39-0c30-4c63-80da-0c9b862f883b): created successfully Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480131df-d872-4545-8d83-9ef4e3cb11d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (a8c2bc10-1452-4e45-b7e5-f997306730ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e04be136-5d8f-40ba-a207-45fd7af46471 tempest-VolumesSnapshotTestJSON-2142202378 None] Created volume successfully. Apr 24 01:15:21 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209" returned: 0 in 0.557s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca916b8-883b-44bc-ab6b-0d2ba94e67da]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:21 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:21 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:22 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.683s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:22 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 Apr 24 01:15:22 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Creating offline snapshot da93c438-4c2c-4190-b014-59042cc66129 of volume 32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:15:22 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2280ac-8aa2-4092-ac61-96ddb082452e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:22 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b Apr 24 01:15:22 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:23 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b" returned: 0 in 0.734s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:23 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 1G Apr 24 01:15:23 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:23 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209" returned: 0 in 0.888s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:23 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209 Apr 24 01:15:23 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:23 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.54fd2d7d-16fa-49ed-b458-370fafb27209" returned: 0 in 0.521s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-54fd2d7d-16fa-49ed-b458-370fafb27209" released by "_delete_snapshot" :: held 2.772s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" released by "delete_snapshot" :: held 2.802s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:24 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 1G" returned: 0 in 0.715s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32780c39-0c30-4c63-80da-0c9b862f883b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:24 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Created reservations ['ac7e0f99-d836-4b1b-8add-3cf4af107273', '48511b6a-86e8-4d0c-a372-70d428e47e1d', '821ed786-1690-49e0-9994-033b30ce5c0d', 'e4f04b25-37e6-4a88-a27c-9ced21684a0e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:24 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32780c39-0c30-4c63-80da-0c9b862f883b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 Apr 24 01:15:24 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:24 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Delete snapshot completed successfully. Apr 24 01:15:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1bc7733c-bfef-4d2c-9185-5412f2cb2429 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-54fd2d7d-16fa-49ed-b458-370fafb27209-delete_snapshot" released by "delete_snapshot" :: held 2.976s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:24 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32780c39-0c30-4c63-80da-0c9b862f883b -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129" returned: 0 in 0.569s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:24 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 is being set with open permissions: ugo+rw Apr 24 01:15:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:24 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 Apr 24 01:15:24 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:25 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129" returned: 0 in 0.484s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:25 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.info Apr 24 01:15:25 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:25 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.info" returned: 0 in 0.452s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:25 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.info is being set with open permissions: ugo+rw Apr 24 01:15:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:25 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.info Apr 24 01:15:25 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:26 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.info" returned: 0 in 0.488s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.527s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.387s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Creating offline snapshot 8b3e13a7-8117-4b30-84f6-c16ab425e988 of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:15:26 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-45f787d8-82bf-44e3-a286-ac7d316cef17 tempest-VolumesSnapshotTestJSON-2142202378 None] Create snapshot completed successfully Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[71304d09-2d75-44bd-9182-5d2b48f9eb5e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:26 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:26 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:26 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.559s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:26 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 1G Apr 24 01:15:26 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (fa69991c-726f-47bf-bee6-97cdc8903241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bbe091-976b-4b50-9526-4b04a57504f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bbe091-976b-4b50-9526-4b04a57504f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-459614913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b341fb6-31b1-4272-8dee-594fb0fc7265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffc7d1deea3440d85e8d471ee4dc343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da93c438-4c2c-4190-b014-59042cc66129,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:27Z,use_quota=True,user_id='00362f54fa9f40ec82aba21834a1b997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152fd4ff-21ef-40f7-88f7-c934962fb1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152fd4ff-21ef-40f7-88f7-c934962fb1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeca181-135e-4dad-9802-62829d742656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeca181-135e-4dad-9802-62829d742656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b341fb6-31b1-4272-8dee-594fb0fc7265', 'volume_name': 'volume-4b341fb6-31b1-4272-8dee-594fb0fc7265', 'volume_size': 1, 'snapshot_id': 'da93c438-4c2c-4190-b014-59042cc66129'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9046c9b-670d-4f62-ac16-64d93b5dba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9046c9b-670d-4f62-ac16-64d93b5dba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f9cadd-1e8d-4a68-b846-f82da2a826d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:27 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Volume 4b341fb6-31b1-4272-8dee-594fb0fc7265: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b341fb6-31b1-4272-8dee-594fb0fc7265', 'volume_size': 1, 'snapshot_id': 'da93c438-4c2c-4190-b014-59042cc66129'} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:27 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 1G" returned: 0 in 0.746s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:27 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 Apr 24 01:15:27 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:27 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988" returned: 0 in 0.467s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:27 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 is being set with open permissions: ugo+rw Apr 24 01:15:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:27 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 Apr 24 01:15:27 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:28 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988" returned: 0 in 0.486s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.139s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-da93c438-4c2c-4190-b014-59042cc66129-4b341fb6-31b1-4272-8dee-594fb0fc7265" by "_create_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-da93c438-4c2c-4190-b014-59042cc66129-4b341fb6-31b1-4272-8dee-594fb0fc7265" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Creating volume 4b341fb6-31b1-4272-8dee-594fb0fc7265 from snapshot da93c438-4c2c-4190-b014-59042cc66129 {{(pid=81925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-4b341fb6-31b1-4272-8dee-594fb0fc7265" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b34321ed-9ab4-44a3-b2cf-77ce0731c151 tempest-SnapshotsActionsTest-1412139356 None] Create snapshot completed successfully Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-4b341fb6-31b1-4272-8dee-594fb0fc7265" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] snapshot: da93c438-4c2c-4190-b014-59042cc66129, volume: 4b341fb6-31b1-4272-8dee-594fb0fc7265, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e6a41-1b43-4e3e-bac5-d0d5225785da]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:28 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 Apr 24 01:15:28 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-8b3e13a7-8117-4b30-84f6-c16ab425e988-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-8b3e13a7-8117-4b30-84f6-c16ab425e988-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Acquiring lock "cinder-quobyte-8b3e13a7-8117-4b30-84f6-c16ab425e988" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-8b3e13a7-8117-4b30-84f6-c16ab425e988" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Deleting offline snapshot 8b3e13a7-8117-4b30-84f6-c16ab425e988 of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] snapshot_file for this snap is: volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[03919951-d1dc-4861-b30d-b3df02821c80]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:29 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129" returned: 0 in 0.622s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32780c39-0c30-4c63-80da-0c9b862f883b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdadbaa-d0be-4053-bd31-da1995249403]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:29 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 Apr 24 01:15:29 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:29 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b Apr 24 01:15:29 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:29 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988" returned: 0 in 0.615s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7415e05b-313a-44d4-bda9-674eee677821]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:29 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b" returned: 0 in 0.625s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:15:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:29 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 Apr 24 01:15:29 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:29 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:29 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:30 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.704s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:30 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 Apr 24 01:15:30 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:32 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988" returned: 0 in 1.585s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:32 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988 Apr 24 01:15:32 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:33 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.8b3e13a7-8117-4b30-84f6-c16ab425e988" returned: 0 in 1.022s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:33 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-8b3e13a7-8117-4b30-84f6-c16ab425e988" released by "_delete_snapshot" :: held 4.084s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:33 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" released by "delete_snapshot" :: held 4.115s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:33 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Created reservations ['49032dcb-9ac4-461e-bf5c-60b9afaf2936', 'c4f1e4b5-b5aa-402c-8552-e13dabca88a5', '03adb863-5eed-4786-a4e5-dc11c37872a8', 'eaf5671b-dfb9-4e52-aed1-64c06e75b18b'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:33 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Delete snapshot completed successfully. Apr 24 01:15:33 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53597e14-df93-46d4-8513-0453344379d4 tempest-SnapshotsActionsTest-497188054 None] Lock "cinder-8b3e13a7-8117-4b30-84f6-c16ab425e988-delete_snapshot" released by "delete_snapshot" :: held 4.387s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "cinder-d536dd1f-9f85-40fc-a5ef-514591f594b1-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-d536dd1f-9f85-40fc-a5ef-514591f594b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" acquired by "delete_snapshot" :: waited 0.087s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "cinder-quobyte-d536dd1f-9f85-40fc-a5ef-514591f594b1" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-quobyte-d536dd1f-9f85-40fc-a5ef-514591f594b1" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Deleting offline snapshot d536dd1f-9f85-40fc-a5ef-514591f594b1 of volume 53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] snapshot_file for this snap is: volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e45663-986e-4f05-93c7-ee9d247580a1]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (bccd52e6-c80b-4aac-bf03-34fef30610ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e125af5f-6fd0-4e9a-b2d4-c7e96d386d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e125af5f-6fd0-4e9a-b2d4-c7e96d386d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-846866502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d770227-29c6-4b06-9914-67de15235b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:36Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff33b3c1-eab8-4f53-b611-d56a757a4b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff33b3c1-eab8-4f53-b611-d56a757a4b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292b4b31-3114-4e2e-ac47-1cbd35def8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292b4b31-3114-4e2e-ac47-1cbd35def8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d770227-29c6-4b06-9914-67de15235b7c', 'volume_name': 'volume-7d770227-29c6-4b06-9914-67de15235b7c', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa40e1f-34b2-492e-bd7f-22c2428cf4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa40e1f-34b2-492e-bd7f-22c2428cf4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:36 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:36 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340c8479-9fb3-4979-8009-f3be2b273232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:36 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Volume 7d770227-29c6-4b06-9914-67de15235b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d770227-29c6-4b06-9914-67de15235b7c', 'volume_size': 1} Apr 24 01:15:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:37 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265" returned: 0 in 7.465s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[469ed546-a8af-4796-a9f5-424964e2707a]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:37 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b Apr 24 01:15:37 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:37 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 1.394s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f49147-c0ec-4bac-847c-bb4ef674a02f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e39f60-7242-46d0-a732-d116fbc93f06]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:37 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f Apr 24 01:15:37 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:37 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f" returned: 0 in 0.571s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:38 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b" returned: 0 in 0.698s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:15:38 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Converted 1024.00 MB image at 137.14 MB/s Apr 24 01:15:38 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 is being set with open permissions: ugo+rw Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:38 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:38 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:38 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 Apr 24 01:15:38 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:38 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265" returned: 0 in 0.513s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-4b341fb6-31b1-4272-8dee-594fb0fc7265" released by "_copy_volume_from_snapshot" :: held 10.023s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-da93c438-4c2c-4190-b014-59042cc66129-4b341fb6-31b1-4272-8dee-594fb0fc7265" released by "_create_volume_from_snapshot" :: held 10.060s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.083s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.251s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-846866502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d770227-29c6-4b06-9914-67de15235b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:36Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Creating volume 7d770227-29c6-4b06-9914-67de15235b7c {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:15:38 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:38 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c 1073741824 Apr 24 01:15:38 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:38 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f9cadd-1e8d-4a68-b846-f82da2a826d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b341fb6-31b1-4272-8dee-594fb0fc7265', 'volume_size': 1, 'snapshot_id': 'da93c438-4c2c-4190-b014-59042cc66129'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2020006b-1da3-49da-ac30-46ac4d2d4f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.624s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:38 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Volume volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 (4b341fb6-31b1-4272-8dee-594fb0fc7265): created successfully Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2020006b-1da3-49da-ac30-46ac4d2d4f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Flow 'volume_create_manager' (fa69991c-726f-47bf-bee6-97cdc8903241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:38 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1 Apr 24 01:15:38 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:38 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0b70bc02-6fc3-475e-9cdf-f8cc1f1e38ed tempest-VolumesSnapshotTestJSON-2142202378 None] Created volume successfully. Apr 24 01:15:39 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f.d536dd1f-9f85-40fc-a5ef-514591f594b1" returned: 0 in 0.565s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-quobyte-d536dd1f-9f85-40fc-a5ef-514591f594b1" released by "_delete_snapshot" :: held 3.359s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" released by "delete_snapshot" :: held 3.437s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Created reservations ['7ffa2998-5c19-412d-8a8d-365efb182394', 'e82878d5-8bb4-40b3-9ace-5ae0e233c9aa', 'b4a64db5-b451-4b66-a71a-502536c97d90', 'e792646e-e6ee-4ed4-ab50-2307a8680260'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:39 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c 1073741824" returned: 0 in 0.745s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:39 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c Apr 24 01:15:39 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:39 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Delete snapshot completed successfully. Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-33b8c9ee-6ac3-47fd-844e-ad8c506c2fd2 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-d536dd1f-9f85-40fc-a5ef-514591f594b1-delete_snapshot" released by "delete_snapshot" :: held 3.695s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-4b341fb6-31b1-4272-8dee-594fb0fc7265-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-4b341fb6-31b1-4272-8dee-594fb0fc7265-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-4b341fb6-31b1-4272-8dee-594fb0fc7265" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-4b341fb6-31b1-4272-8dee-594fb0fc7265" acquired by "delete_volume" :: waited 0.033s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e97f1-c943-4022-9466-031f8f95b901]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:39 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c" returned: 0 in 0.536s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340c8479-9fb3-4979-8009-f3be2b273232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d770227-29c6-4b06-9914-67de15235b7c', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35db4563-f8e9-4ad5-891c-f179ab728156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:39 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Volume volume-7d770227-29c6-4b06-9914-67de15235b7c (7d770227-29c6-4b06-9914-67de15235b7c): created successfully Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35db4563-f8e9-4ad5-891c-f179ab728156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:39 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 Apr 24 01:15:39 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (bccd52e6-c80b-4aac-bf03-34fef30610ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:39 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-6492b034-b39d-404f-a9f5-ea6907e72fc2 tempest-VolumesActionsTest-578823602 None] Created volume successfully. Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "cinder-53f49147-c0ec-4bac-847c-bb4ef674a02f-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-53f49147-c0ec-4bac-847c-bb4ef674a02f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f911defb-0b6d-44c5-9f32-ff619edadc15]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-eda67f90-49a0-4a1a-a58d-ec857fb8c345 tempest-VolumesActionsTest-578823602 None] Acquiring lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c" by "attach_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:40 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f Apr 24 01:15:40 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-eda67f90-49a0-4a1a-a58d-ec857fb8c345 tempest-VolumesActionsTest-578823602 None] Lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c" acquired by "attach_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-eda67f90-49a0-4a1a-a58d-ec857fb8c345 tempest-VolumesActionsTest-578823602 None] Attaching volume 7d770227-29c6-4b06-9914-67de15235b7c to instance 22e18411-6230-4ace-8c20-fa941ad09111 at mountpoint /dev/vdb on host None. Apr 24 01:15:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-eda67f90-49a0-4a1a-a58d-ec857fb8c345 tempest-VolumesActionsTest-578823602 None] Attach volume completed successfully. Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-eda67f90-49a0-4a1a-a58d-ec857fb8c345 tempest-VolumesActionsTest-578823602 None] Lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c" released by "attach_volume" :: held 0.120s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:40 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265" returned: 0 in 0.722s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:40 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265 Apr 24 01:15:40 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:40 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f" returned: 0 in 0.746s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:41 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f Apr 24 01:15:41 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:41 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4b341fb6-31b1-4272-8dee-594fb0fc7265" returned: 0 in 0.587s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-4b341fb6-31b1-4272-8dee-594fb0fc7265" released by "delete_volume" :: held 1.357s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Created reservations ['6603a684-f1b7-4caa-be1c-78e9dc6f4999', '4e18da06-06ca-4b17-85bc-2c6d1b20f0fe', '67423506-2d00-4a39-b55b-54432dc856bc', '40dd4ba9-7016-416c-84f4-8f340437cd90'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:41 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:41 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:41 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-60f13054-bd93-49a9-93eb-cb0e04a1af58 tempest-VolumesActionsTest-91388073 None] Terminate volume connection completed successfully. Apr 24 01:15:41 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-53f49147-c0ec-4bac-847c-bb4ef674a02f" returned: 0 in 0.559s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-quobyte-53f49147-c0ec-4bac-847c-bb4ef674a02f" released by "delete_volume" :: held 1.401s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Created reservations ['204d250a-605f-4261-87e0-e3a2d849bed5', 'cbb9e8dc-0ef0-4508-a054-e534f55eb9e4', '7c534f27-6283-470c-a68f-07cf501d1e86', '86737e78-b2d2-44c5-8738-d08b0773782e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:41 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:41 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:41 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.517s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:41 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Deleted volume successfully. Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-049cfda6-426b-4506-83f2-432dc218a082 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-4b341fb6-31b1-4272-8dee-594fb0fc7265-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-60f13054-bd93-49a9-93eb-cb0e04a1af58 tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-detach_volume" by "detach_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-60f13054-bd93-49a9-93eb-cb0e04a1af58 tempest-VolumesActionsTest-91388073 None] Lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-da93c438-4c2c-4190-b014-59042cc66129-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-60f13054-bd93-49a9-93eb-cb0e04a1af58 tempest-VolumesActionsTest-91388073 None] Detaching volume 7d770227-29c6-4b06-9914-67de15235b7c from instance 22e18411-6230-4ace-8c20-fa941ad09111. Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-da93c438-4c2c-4190-b014-59042cc66129-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-32780c39-0c30-4c63-80da-0c9b862f883b" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-32780c39-0c30-4c63-80da-0c9b862f883b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-da93c438-4c2c-4190-b014-59042cc66129" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-da93c438-4c2c-4190-b014-59042cc66129" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Deleting offline snapshot da93c438-4c2c-4190-b014-59042cc66129 of volume 32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] snapshot_file for this snap is: volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:15:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-60f13054-bd93-49a9-93eb-cb0e04a1af58 tempest-VolumesActionsTest-91388073 None] Detach volume completed successfully. Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c189a4fd-9a99-422e-a7eb-caae471e53f2]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-60f13054-bd93-49a9-93eb-cb0e04a1af58 tempest-VolumesActionsTest-91388073 None] Lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-detach_volume" released by "detach_volume" :: held 0.175s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:42 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.516s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Deleted volume successfully. Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1356a83d-5acb-400b-8e9f-64d40d76d222 tempest-SnapshotsActionsTest-1412139356 None] Lock "cinder-53f49147-c0ec-4bac-847c-bb4ef674a02f-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:42 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 Apr 24 01:15:42 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-39244125-4c2c-4ff8-b991-982098354df6 tempest-VolumesActionsTest-578823602 None] Acquiring lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-detach_volume" by "detach_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-39244125-4c2c-4ff8-b991-982098354df6 tempest-VolumesActionsTest-578823602 None] Lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-39244125-4c2c-4ff8-b991-982098354df6 tempest-VolumesActionsTest-578823602 None] Volume detach called, but volume not attached. Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-39244125-4c2c-4ff8-b991-982098354df6 tempest-VolumesActionsTest-578823602 None] Lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:42 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129" returned: 0 in 0.700s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32780c39-0c30-4c63-80da-0c9b862f883b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[02891d42-f046-4924-96b9-fd7ab809457b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:42 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b Apr 24 01:15:42 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Acquiring lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Acquiring lock "cinder-quobyte-7d770227-29c6-4b06-9914-67de15235b7c" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Lock "cinder-quobyte-7d770227-29c6-4b06-9914-67de15235b7c" acquired by "delete_volume" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:43 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8388c8-a311-445f-9d26-f30209adcd23]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:43 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b" returned: 0 in 0.812s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:43 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 Apr 24 01:15:43 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:43 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c Apr 24 01:15:43 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:44 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c" returned: 0 in 0.801s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:44 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c Apr 24 01:15:44 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:44 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129" returned: 0 in 1.086s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:44 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129 Apr 24 01:15:44 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:45 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7d770227-29c6-4b06-9914-67de15235b7c" returned: 0 in 0.538s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Lock "cinder-quobyte-7d770227-29c6-4b06-9914-67de15235b7c" released by "delete_volume" :: held 1.394s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Created reservations ['1a29b900-b4ea-421d-bd74-30c88a564558', 'fd819c80-558a-4567-924e-869b5e123b63', 'fc356a1a-0cc6-4292-a3c9-cca26a420f2f', 'cc6fbc16-c313-4ce4-90da-843ce12f3fcf'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:45 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:45 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:45 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b.da93c438-4c2c-4190-b014-59042cc66129" returned: 0 in 0.580s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-da93c438-4c2c-4190-b014-59042cc66129" released by "_delete_snapshot" :: held 3.299s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-32780c39-0c30-4c63-80da-0c9b862f883b" released by "delete_snapshot" :: held 3.332s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Created reservations ['688fc4c6-615f-4f87-9b64-9f4144af14a6', '72204570-a0a4-444f-91e3-9880667ebe24', '095bb26d-292e-4546-9c99-1c819940ee3d', '457c46c8-78e1-48ed-8dfb-711b9eb6626e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:45 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Delete snapshot completed successfully. Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d6eea8a4-208d-4f8e-ac89-c5ea3e8c70d1 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-da93c438-4c2c-4190-b014-59042cc66129-delete_snapshot" released by "delete_snapshot" :: held 3.504s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:45 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.510s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:45 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Deleted volume successfully. Apr 24 01:15:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f906ef50-5013-4a0f-8189-4c339dd54b4b tempest-VolumesActionsTest-578823602 None] Lock "cinder-7d770227-29c6-4b06-9914-67de15235b7c-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-32780c39-0c30-4c63-80da-0c9b862f883b-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-32780c39-0c30-4c63-80da-0c9b862f883b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-32780c39-0c30-4c63-80da-0c9b862f883b" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-32780c39-0c30-4c63-80da-0c9b862f883b" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:46 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9edc27-386e-4263-b7cd-d4c66be97cf2]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:46 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b Apr 24 01:15:46 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:47 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b" returned: 0 in 0.639s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:47 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b Apr 24 01:15:47 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:47 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-32780c39-0c30-4c63-80da-0c9b862f883b" returned: 0 in 0.637s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-32780c39-0c30-4c63-80da-0c9b862f883b" released by "delete_volume" :: held 1.345s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Created reservations ['1b4a34cb-0b17-4d46-a39f-5ab8d2663aec', '59996e67-7969-46c6-ac3d-005a594e0590', '6f03ed2e-08b0-4383-b420-d68da0a90388', '0a14a29e-9532-4c6d-9b9b-52f58bdc39f3'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:47 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:47 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:48 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.483s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Deleted volume successfully. Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0c2fde52-db79-45e7-a3ef-2adbc45e5793 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-32780c39-0c30-4c63-80da-0c9b862f883b-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-4ee87d18-414a-48e2-b8d4-5b8fe165eb72-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-4ee87d18-414a-48e2-b8d4-5b8fe165eb72-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "cinder-quobyte-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d94f5e-0f63-4383-ba08-ae648c6cede5]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:49 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 Apr 24 01:15:49 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:49 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" returned: 0 in 0.678s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:49 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72 Apr 24 01:15:49 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:50 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" returned: 0 in 0.637s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-quobyte-4ee87d18-414a-48e2-b8d4-5b8fe165eb72" released by "delete_volume" :: held 1.395s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Created reservations ['20295457-ebcf-435a-a883-dda380790ab7', '02a13c9a-0c4a-448a-9a3f-150c933f5339', '47937dd4-8993-40b2-9610-0a0e4bc72603', '2290b558-9e11-402d-be14-df60344d046c'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:50 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:50 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:50 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.513s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:50 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:50 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Deleted volume successfully. Apr 24 01:15:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0d8e38b6-9183-4f92-b012-104feb833ef8 tempest-VolumesSnapshotTestJSON-2142202378 None] Lock "cinder-4ee87d18-414a-48e2-b8d4-5b8fe165eb72-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Flow 'volume_create_manager' (b73bec32-789f-491d-84e0-bf219be40842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82066279-1c13-4e5a-864a-cfad5557dd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82066279-1c13-4e5a-864a-cfad5557dd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-979870078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acf4a7a-b70d-426e-8b4c-018ccb38ea64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f361b503a4568a92b9c85bdefdb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:54Z,use_quota=True,user_id='d0463ad8e3cf45e7838aad0a9fbe8894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c227d5a-b05b-4b98-b0f2-44ca83068963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c227d5a-b05b-4b98-b0f2-44ca83068963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29d015c-95b5-4366-b4bc-17b032347a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29d015c-95b5-4366-b4bc-17b032347a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5acf4a7a-b70d-426e-8b4c-018ccb38ea64', 'volume_name': 'volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200ab6fe-70e8-43cc-99ba-aa45c71bde3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200ab6fe-70e8-43cc-99ba-aa45c71bde3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c4fcb6-7b55-49ff-9abf-679969f32abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:54 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Volume 5acf4a7a-b70d-426e-8b4c-018ccb38ea64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64', 'volume_size': 1} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-979870078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acf4a7a-b70d-426e-8b4c-018ccb38ea64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f361b503a4568a92b9c85bdefdb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:54Z,use_quota=True,user_id='d0463ad8e3cf45e7838aad0a9fbe8894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Creating volume 5acf4a7a-b70d-426e-8b4c-018ccb38ea64 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:15:54 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:15:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:54 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 1073741824 Apr 24 01:15:54 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:55 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 1073741824" returned: 0 in 0.849s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:55 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 Apr 24 01:15:55 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (3fd46ae0-5cc9-44a1-9e26-4563e0456936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c15c434-5932-4394-8d81-c72e26113e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c15c434-5932-4394-8d81-c72e26113e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1460273732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8169a5b1-c6c2-4340-bcc4-1c6a80060c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:55Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c0f85a-a740-405e-b601-a4854aa24501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c0f85a-a740-405e-b601-a4854aa24501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff1797f-6d86-4399-b4e9-96974e7bb5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff1797f-6d86-4399-b4e9-96974e7bb5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8169a5b1-c6c2-4340-bcc4-1c6a80060c94', 'volume_name': 'volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff3201c-f776-4da7-8757-d4d87c6c6e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff3201c-f776-4da7-8757-d4d87c6c6e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067bac2b-cf3a-4e81-b6e4-b63e427204ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:55 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Volume 8169a5b1-c6c2-4340-bcc4-1c6a80060c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94', 'volume_size': 1} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:55 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64" returned: 0 in 0.467s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.163s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1460273732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8169a5b1-c6c2-4340-bcc4-1c6a80060c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:55Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Creating volume 8169a5b1-c6c2-4340-bcc4-1c6a80060c94 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:15:55 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c4fcb6-7b55-49ff-9abf-679969f32abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ef9e8-729a-4b69-9828-8ed18716ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:55 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 1073741824 Apr 24 01:15:55 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:55 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Volume volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 (5acf4a7a-b70d-426e-8b4c-018ccb38ea64): created successfully Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ef9e8-729a-4b69-9828-8ed18716ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Flow 'volume_create_manager' (b73bec32-789f-491d-84e0-bf219be40842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0988b191-dbb6-4864-8ed9-540acc30cb19 tempest-VolumesListAdminTestJSON-446435400 None] Created volume successfully. Apr 24 01:15:56 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 1073741824" returned: 0 in 0.842s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:56 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 Apr 24 01:15:56 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Flow 'volume_create_manager' (ab8dfb80-1a68-4204-b128-c0f25a8a0deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42a94cb-2545-4174-b99e-9f021dafc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42a94cb-2545-4174-b99e-9f021dafc88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-404570556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc89c245-d9cc-4843-9b8e-d7b21c570c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f361b503a4568a92b9c85bdefdb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:57Z,use_quota=True,user_id='d0463ad8e3cf45e7838aad0a9fbe8894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd2500d-8734-461e-a305-c78f6dfeb7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd2500d-8734-461e-a305-c78f6dfeb7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42e9cc1-0878-4550-a6c1-883790adb69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42e9cc1-0878-4550-a6c1-883790adb69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc89c245-d9cc-4843-9b8e-d7b21c570c1d', 'volume_name': 'volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42574909-d351-4c6a-bbe6-e340d01abd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42574909-d351-4c6a-bbe6-e340d01abd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adee3b7b-c2bb-42bc-8943-1910da99203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:56 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Volume dc89c245-d9cc-4843-9b8e-d7b21c570c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d', 'volume_size': 1} Apr 24 01:15:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:57 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94" returned: 0 in 0.496s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.299s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-404570556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc89c245-d9cc-4843-9b8e-d7b21c570c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f361b503a4568a92b9c85bdefdb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:57Z,use_quota=True,user_id='d0463ad8e3cf45e7838aad0a9fbe8894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Creating volume dc89c245-d9cc-4843-9b8e-d7b21c570c1d {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:15:57 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067bac2b-cf3a-4e81-b6e4-b63e427204ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:57 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d 1073741824 Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71436531-913a-4c05-9243-a45bd97b1f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:57 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:57 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Volume volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 (8169a5b1-c6c2-4340-bcc4-1c6a80060c94): created successfully Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71436531-913a-4c05-9243-a45bd97b1f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (3fd46ae0-5cc9-44a1-9e26-4563e0456936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:57 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ab5d9d9a-603d-4da7-8fd8-b664175a51aa tempest-VolumesActionsTest-578823602 None] Created volume successfully. Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-8169a5b1-c6c2-4340-bcc4-1c6a80060c94-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Lock "cinder-8169a5b1-c6c2-4340-bcc4-1c6a80060c94-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-quobyte-8169a5b1-c6c2-4340-bcc4-1c6a80060c94" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Lock "cinder-quobyte-8169a5b1-c6c2-4340-bcc4-1c6a80060c94" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5367dcb-170d-4502-8ee9-dccb51445c40]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:57 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 Apr 24 01:15:57 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:57 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d 1073741824" returned: 0 in 0.675s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:57 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d Apr 24 01:15:57 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:58 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94" returned: 0 in 0.578s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:58 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94 Apr 24 01:15:58 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:58 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d" returned: 0 in 0.473s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adee3b7b-c2bb-42bc-8943-1910da99203b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fff625-5fd2-49c5-9055-fc8a59bfaa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:58 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Volume volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d (dc89c245-d9cc-4843-9b8e-d7b21c570c1d): created successfully Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fff625-5fd2-49c5-9055-fc8a59bfaa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Flow 'volume_create_manager' (ab8dfb80-1a68-4204-b128-c0f25a8a0deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:58 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f9b8a3e4-6331-482b-8efd-1f94b5771830 tempest-VolumesListAdminTestJSON-446435400 None] Created volume successfully. Apr 24 01:15:58 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8169a5b1-c6c2-4340-bcc4-1c6a80060c94" returned: 0 in 0.436s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Lock "cinder-quobyte-8169a5b1-c6c2-4340-bcc4-1c6a80060c94" released by "delete_volume" :: held 1.058s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Created reservations ['58231626-82dd-4c17-a4d4-16812aade245', 'a930c9c4-2617-4dc1-ae11-1784328acdbf', '896f0736-2e32-4a1b-8980-d1514ec4b403', '374448eb-2366-4dc8-99a2-d34881e54ba2'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:58 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:15:58 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:15:59 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Flow 'volume_create_manager' (8fd69f84-0425-4979-86e4-6319a5fe2e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada0298a-1715-46ae-ba2c-a5beeaaeb9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada0298a-1715-46ae-ba2c-a5beeaaeb9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2123887464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a47179-539b-4311-b7c6-d0d16ab2f85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f361b503a4568a92b9c85bdefdb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:59Z,use_quota=True,user_id='d0463ad8e3cf45e7838aad0a9fbe8894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46faad9f-8f63-4c3b-863f-8fe9bb14bb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46faad9f-8f63-4c3b-863f-8fe9bb14bb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a74fcd-9286-482b-bd69-a14c0dd296e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a74fcd-9286-482b-bd69-a14c0dd296e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a47179-539b-4311-b7c6-d0d16ab2f85e', 'volume_name': 'volume-65a47179-539b-4311-b7c6-d0d16ab2f85e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7f4f81-cfbf-4581-abff-3ba38692eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7f4f81-cfbf-4581-abff-3ba38692eacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc412440-3ffc-4960-b869-fff989f3e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:15:59 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Volume 65a47179-539b-4311-b7c6-d0d16ab2f85e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a47179-539b-4311-b7c6-d0d16ab2f85e', 'volume_size': 1} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2123887464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a47179-539b-4311-b7c6-d0d16ab2f85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f361b503a4568a92b9c85bdefdb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:15:59Z,use_quota=True,user_id='d0463ad8e3cf45e7838aad0a9fbe8894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Creating volume 65a47179-539b-4311-b7c6-d0d16ab2f85e {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:15:59 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:15:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Deleted volume successfully. Apr 24 01:15:59 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e 1073741824 Apr 24 01:15:59 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:15:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21bde87b-6e79-4a7b-b0a6-ea961ae21f41 tempest-VolumesActionsTest-91388073 None] Lock "cinder-8169a5b1-c6c2-4340-bcc4-1c6a80060c94-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:00 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e 1073741824" returned: 0 in 0.653s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:00 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e Apr 24 01:16:00 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (d32e3a99-e058-42c2-bc1b-ea6d963993a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baf2570-4093-4a90-8725-54ac77b9abc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baf2570-4093-4a90-8725-54ac77b9abc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1745194340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d342f8a-635a-4e6f-aca8-afc32f1fee96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:00Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303ee8f3-8bdc-4aac-ac45-d7ee3ea94cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303ee8f3-8bdc-4aac-ac45-d7ee3ea94cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cde675e-90d0-4112-81be-d67c7a90cef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cde675e-90d0-4112-81be-d67c7a90cef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d342f8a-635a-4e6f-aca8-afc32f1fee96', 'volume_name': 'volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cbb273-9486-4ec7-8046-428a5effd536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cbb273-9486-4ec7-8046-428a5effd536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967f4f27-ac90-4da5-813d-44e7528c31a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:00 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Volume 0d342f8a-635a-4e6f-aca8-afc32f1fee96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96', 'volume_size': 1} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:00 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e" returned: 0 in 0.470s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.261s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1745194340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d342f8a-635a-4e6f-aca8-afc32f1fee96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:00Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Creating volume 0d342f8a-635a-4e6f-aca8-afc32f1fee96 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:00 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc412440-3ffc-4960-b869-fff989f3e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a47179-539b-4311-b7c6-d0d16ab2f85e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da7b90f-5fdc-4aa2-850c-0eaacefb5968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:00 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 1073741824 Apr 24 01:16:00 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:00 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Volume volume-65a47179-539b-4311-b7c6-d0d16ab2f85e (65a47179-539b-4311-b7c6-d0d16ab2f85e): created successfully Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da7b90f-5fdc-4aa2-850c-0eaacefb5968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:00 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Flow 'volume_create_manager' (8fd69f84-0425-4979-86e4-6319a5fe2e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:00 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9ee6a628-32f8-4f39-a170-76e6ec832121 tempest-VolumesListAdminTestJSON-446435400 None] Created volume successfully. Apr 24 01:16:01 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 1073741824" returned: 0 in 0.605s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:01 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 Apr 24 01:16:01 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:01 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96" returned: 0 in 0.481s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967f4f27-ac90-4da5-813d-44e7528c31a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5990ac25-bc59-4e0c-bdbd-bb5984929f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:01 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Volume volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 (0d342f8a-635a-4e6f-aca8-afc32f1fee96): created successfully Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5990ac25-bc59-4e0c-bdbd-bb5984929f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:01 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (d32e3a99-e058-42c2-bc1b-ea6d963993a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:01 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ebc57e9e-fcee-44fc-bef3-701df7621ffc tempest-VolumesActionsTest-578823602 None] Created volume successfully. Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Flow 'volume_create_manager' (d83e202d-aad5-42f0-932b-0797f0dc2830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12c4c2c-c52b-4cc6-8190-8b253c9d16e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12c4c2c-c52b-4cc6-8190-8b253c9d16e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef3eb5a-25fb-469a-b93b-48a3b5e0825d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4556bb66b4a2f95b6fd49bb0d94c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:02Z,use_quota=True,user_id='544a4de7ba36404e9266eb089d610600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e25247-d9e8-4c50-8ac0-5d1be1185f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e25247-d9e8-4c50-8ac0-5d1be1185f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab38885-ccea-43fd-be52-7edf0ee694da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab38885-ccea-43fd-be52-7edf0ee694da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef3eb5a-25fb-469a-b93b-48a3b5e0825d', 'volume_name': 'volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5a1529-b91c-4952-a39d-bff773e05ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5a1529-b91c-4952-a39d-bff773e05ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55624837-8d78-48f5-ade4-c22cb4b13472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:02 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Volume 7ef3eb5a-25fb-469a-b93b-48a3b5e0825d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d', 'volume_size': 1} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef3eb5a-25fb-469a-b93b-48a3b5e0825d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4556bb66b4a2f95b6fd49bb0d94c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:02Z,use_quota=True,user_id='544a4de7ba36404e9266eb089d610600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Creating volume 7ef3eb5a-25fb-469a-b93b-48a3b5e0825d {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:02 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:02 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d 1073741824 Apr 24 01:16:02 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-0d342f8a-635a-4e6f-aca8-afc32f1fee96-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Lock "cinder-0d342f8a-635a-4e6f-aca8-afc32f1fee96-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-quobyte-0d342f8a-635a-4e6f-aca8-afc32f1fee96" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Lock "cinder-quobyte-0d342f8a-635a-4e6f-aca8-afc32f1fee96" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2422e0a-6f2e-4cd0-a0f2-76aa6dd57b90]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:02 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 Apr 24 01:16:02 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:02 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d 1073741824" returned: 0 in 0.687s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:02 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d Apr 24 01:16:02 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:03 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96" returned: 0 in 0.584s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:03 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96 Apr 24 01:16:03 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:03 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d" returned: 0 in 0.523s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55624837-8d78-48f5-ade4-c22cb4b13472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd03c85-db81-47e6-909a-00017d0917da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:03 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Volume volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d (7ef3eb5a-25fb-469a-b93b-48a3b5e0825d): created successfully Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd03c85-db81-47e6-909a-00017d0917da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Flow 'volume_create_manager' (d83e202d-aad5-42f0-932b-0797f0dc2830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:03 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-db130dbc-85df-48fe-8719-c81131e648e1 tempest-VolumesListAdminTestJSON-1228476359 None] Created volume successfully. Apr 24 01:16:03 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0d342f8a-635a-4e6f-aca8-afc32f1fee96" returned: 0 in 0.455s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Lock "cinder-quobyte-0d342f8a-635a-4e6f-aca8-afc32f1fee96" released by "delete_volume" :: held 1.081s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Created reservations ['1850fb8b-2048-4516-ae39-6f516ce77c57', 'bacddf8a-760a-474e-a970-73ef92203c2d', '1bcdd5d8-cb57-4b8e-8b9e-7b796779dbf6', '5a9bb30c-4540-4bc0-8d02-528a979a9770'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:03 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:03 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:04 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.469s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:04 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Deleted volume successfully. Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3e21c8d-dacd-4f53-9403-c8971bca0e49 tempest-VolumesActionsTest-91388073 None] Lock "cinder-0d342f8a-635a-4e6f-aca8-afc32f1fee96-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Acquiring lock "cinder-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "cinder-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Acquiring lock "cinder-quobyte-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "cinder-quobyte-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf2e2e-ef17-4282-89c5-949776f5f31b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "cinder-65a47179-539b-4311-b7c6-d0d16ab2f85e-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-65a47179-539b-4311-b7c6-d0d16ab2f85e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:04 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d Apr 24 01:16:04 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "cinder-quobyte-65a47179-539b-4311-b7c6-d0d16ab2f85e" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-quobyte-65a47179-539b-4311-b7c6-d0d16ab2f85e" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa2076b-afe4-4d01-9942-6043c1cdb7d4]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:04 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e Apr 24 01:16:04 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (1905558d-9368-4e08-8c78-6f66b01d0ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09836812-57c5-4677-aeea-cb55f5f50135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09836812-57c5-4677-aeea-cb55f5f50135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1467838140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b515dae-ef7e-4039-9093-8a24112b718e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:05Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2c7805-b140-47f0-870c-1a06d3bca26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:05 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2c7805-b140-47f0-870c-1a06d3bca26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45258c76-c4f4-4940-b7a3-a863702ed2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45258c76-c4f4-4940-b7a3-a863702ed2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b515dae-ef7e-4039-9093-8a24112b718e', 'volume_name': 'volume-9b515dae-ef7e-4039-9093-8a24112b718e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6044b9-8dcf-42bb-82bb-f3d546f4767e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6044b9-8dcf-42bb-82bb-f3d546f4767e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31796256-245f-4c9e-b263-e5d869d6e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:05 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Volume 9b515dae-ef7e-4039-9093-8a24112b718e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b515dae-ef7e-4039-9093-8a24112b718e', 'volume_size': 1} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1467838140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b515dae-ef7e-4039-9093-8a24112b718e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:05Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Creating volume 9b515dae-ef7e-4039-9093-8a24112b718e {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:05 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d" returned: 0 in 0.829s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:05 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e 1073741824 Apr 24 01:16:05 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:05 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d Apr 24 01:16:05 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:05 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e" returned: 0 in 0.807s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:05 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e Apr 24 01:16:05 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:05 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d" returned: 0 in 0.570s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "cinder-quobyte-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d" released by "delete_volume" :: held 1.440s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:05 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Created reservations ['99cf58e3-9d7c-4c73-a652-7a500202330b', 'a77732bd-94fa-492a-8f6f-c75d636091e8', '05c481af-ded4-4455-a6ba-2f3d3593dfb6', '79464b29-aca1-4bc7-b4cc-9ff8e137bf90'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:06 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e 1073741824" returned: 0 in 0.739s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:06 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:06 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:06 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-65a47179-539b-4311-b7c6-d0d16ab2f85e" returned: 0 in 0.598s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:06 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e Apr 24 01:16:06 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-quobyte-65a47179-539b-4311-b7c6-d0d16ab2f85e" released by "delete_volume" :: held 1.462s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Created reservations ['856780b7-8eeb-48d9-aa9a-a8046a52ab3f', 'b9b0110a-1405-4df0-be0e-cf63463b4b49', '23568bb1-b8bf-4c04-b08e-869911232835', 'f1e5ddc0-0173-44ed-8061-b6bd3606ec19'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:06 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:06 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:06 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.478s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Deleted volume successfully. Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b92bd056-ebb5-4aca-a87d-152710e51cd5 tempest-VolumesListAdminTestJSON-1228476359 None] Lock "cinder-7ef3eb5a-25fb-469a-b93b-48a3b5e0825d-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:06 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e" returned: 0 in 0.528s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31796256-245f-4c9e-b263-e5d869d6e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b515dae-ef7e-4039-9093-8a24112b718e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0d90dc-3057-40ed-8576-be4c3ac28ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:06 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Volume volume-9b515dae-ef7e-4039-9093-8a24112b718e (9b515dae-ef7e-4039-9093-8a24112b718e): created successfully Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0d90dc-3057-40ed-8576-be4c3ac28ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (1905558d-9368-4e08-8c78-6f66b01d0ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9582daf5-50eb-42ae-b31e-10268d731508 tempest-VolumesActionsTest-578823602 None] Created volume successfully. Apr 24 01:16:06 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.454s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Deleted volume successfully. Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ee5cba98-edaa-461c-b2cb-4d5110c53754 tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-65a47179-539b-4311-b7c6-d0d16ab2f85e-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "cinder-dc89c245-d9cc-4843-9b8e-d7b21c570c1d-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-dc89c245-d9cc-4843-9b8e-d7b21c570c1d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "cinder-quobyte-dc89c245-d9cc-4843-9b8e-d7b21c570c1d" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-quobyte-dc89c245-d9cc-4843-9b8e-d7b21c570c1d" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d7f012-2599-4fef-ad92-87ad0ce177c7]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:07 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d Apr 24 01:16:07 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:07 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-9b515dae-ef7e-4039-9093-8a24112b718e-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d" returned: 0 in 0.556s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Lock "cinder-9b515dae-ef7e-4039-9093-8a24112b718e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:07 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d Apr 24 01:16:07 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-quobyte-9b515dae-ef7e-4039-9093-8a24112b718e" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Lock "cinder-quobyte-9b515dae-ef7e-4039-9093-8a24112b718e" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[49278eef-96f1-4680-91ef-e7b39ff8aa92]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:07 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e Apr 24 01:16:07 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:07 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-dc89c245-d9cc-4843-9b8e-d7b21c570c1d" returned: 0 in 0.478s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-quobyte-dc89c245-d9cc-4843-9b8e-d7b21c570c1d" released by "delete_volume" :: held 1.075s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Created reservations ['2ca5b5d4-0b84-4613-a020-0f0ae7554ea3', '83f914a9-5012-4497-b46f-8d52e6bc2116', 'a025ae3b-db61-4b80-bc01-fc7775a8d74a', '24a762ec-6200-4b22-ba6b-b227b659eb27'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:08 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e" returned: 0 in 0.540s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:08 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:08 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:08 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e Apr 24 01:16:08 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:08 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.460s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:08 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Deleted volume successfully. Apr 24 01:16:08 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9b515dae-ef7e-4039-9093-8a24112b718e" returned: 0 in 0.464s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Lock "cinder-quobyte-9b515dae-ef7e-4039-9093-8a24112b718e" released by "delete_volume" :: held 1.043s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-249c4f8d-2ebc-4cc5-8a7a-458cd0b67c75 tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-dc89c245-d9cc-4843-9b8e-d7b21c570c1d-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Created reservations ['2009f6c5-216a-4e11-9592-c7c0566ccf1a', '3889fde8-b664-4b1b-b785-9979f8783d3d', 'c5fc7e53-522d-4663-b973-096edd17313c', '35d64722-821b-48b9-ba3f-d14a46b1db1d'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:08 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:08 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "cinder-5acf4a7a-b70d-426e-8b4c-018ccb38ea64-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-5acf4a7a-b70d-426e-8b4c-018ccb38ea64-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "cinder-quobyte-5acf4a7a-b70d-426e-8b4c-018ccb38ea64" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-quobyte-5acf4a7a-b70d-426e-8b4c-018ccb38ea64" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbcec51-1987-4a86-a3cb-2a9fc5d3ea1d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:09 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.465s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:09 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Deleted volume successfully. Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a08681f5-c0b1-4d84-8ba1-895e0908e01b tempest-VolumesActionsTest-91388073 None] Lock "cinder-9b515dae-ef7e-4039-9093-8a24112b718e-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:09 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 Apr 24 01:16:09 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:09 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64" returned: 0 in 0.527s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:09 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64 Apr 24 01:16:09 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (52fb43bf-dff2-4e93-9117-53a4fd594d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9d5f02-1a79-443e-9f00-c07c8373ce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9d5f02-1a79-443e-9f00-c07c8373ce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223757481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e1558d-e7e1-4076-b1d2-cae777121f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:10Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5343e4-93d6-456e-810e-011622c43eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5343e4-93d6-456e-810e-011622c43eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef1aad0-00e6-42ae-b4ce-cb3d8691c503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef1aad0-00e6-42ae-b4ce-cb3d8691c503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e1558d-e7e1-4076-b1d2-cae777121f2e', 'volume_name': 'volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c411e912-c7ef-4d81-bb9c-e816ef03ba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c411e912-c7ef-4d81-bb9c-e816ef03ba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8032ca7-c8ad-4919-b6af-19d76a9b4f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:10 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Volume c5e1558d-e7e1-4076-b1d2-cae777121f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e', 'volume_size': 1} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223757481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e1558d-e7e1-4076-b1d2-cae777121f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:10Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Creating volume c5e1558d-e7e1-4076-b1d2-cae777121f2e {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:10 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:10 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e 1073741824 Apr 24 01:16:10 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:10 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5acf4a7a-b70d-426e-8b4c-018ccb38ea64" returned: 0 in 0.499s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-quobyte-5acf4a7a-b70d-426e-8b4c-018ccb38ea64" released by "delete_volume" :: held 1.071s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Created reservations ['28fdc15b-1257-4690-8390-aaea5319c700', '7f435795-4484-44e6-8ce4-100f5c94fad1', '4d6c9161-9671-4b62-8983-39d02fb06134', '19b1cb83-8fad-40ab-9e70-bdd5a27d2d2a'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:10 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:10 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:10 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e 1073741824" returned: 0 in 0.627s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:10 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.450s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:10 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Deleted volume successfully. Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:10 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c79cc0a-2d28-4b02-95ba-8a156829c25d tempest-VolumesListAdminTestJSON-446435400 None] Lock "cinder-5acf4a7a-b70d-426e-8b4c-018ccb38ea64-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:10 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e Apr 24 01:16:10 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:11 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e" returned: 0 in 0.448s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8032ca7-c8ad-4919-b6af-19d76a9b4f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934017b0-2fb7-4388-b21a-e814a330e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:11 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Volume volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e (c5e1558d-e7e1-4076-b1d2-cae777121f2e): created successfully Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934017b0-2fb7-4388-b21a-e814a330e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (52fb43bf-dff2-4e93-9117-53a4fd594d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:11 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-7c6876a9-3a9d-4c72-8830-6317e974f0e6 tempest-VolumesActionsTest-578823602 None] Created volume successfully. Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:11 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:11 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:12 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.520s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-c5e1558d-e7e1-4076-b1d2-cae777121f2e-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Lock "cinder-c5e1558d-e7e1-4076-b1d2-cae777121f2e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Acquiring lock "cinder-quobyte-c5e1558d-e7e1-4076-b1d2-cae777121f2e" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Lock "cinder-quobyte-c5e1558d-e7e1-4076-b1d2-cae777121f2e" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:12 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88ff875-4c25-4fff-8e0c-26678fe5ca13]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:12 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e Apr 24 01:16:12 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:13 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e" returned: 0 in 0.594s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:13 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e Apr 24 01:16:13 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:13 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e1558d-e7e1-4076-b1d2-cae777121f2e" returned: 0 in 0.525s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Lock "cinder-quobyte-c5e1558d-e7e1-4076-b1d2-cae777121f2e" released by "delete_volume" :: held 1.161s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Created reservations ['50c36b8c-12e7-40e2-9172-09320a8e0f76', 'bdd22e38-235a-4ecf-addd-944dd2f08db3', '05a7f4ee-ccba-4318-bb48-8217af6322e4', '5e60240f-3110-4e53-8257-3eb21d333e65'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:13 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:13 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:14 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.469s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:14 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:14 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Deleted volume successfully. Apr 24 01:16:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e760f824-0f5b-4c5c-ac59-ead280102eda tempest-VolumesActionsTest-91388073 None] Lock "cinder-c5e1558d-e7e1-4076-b1d2-cae777121f2e-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (ce7bb544-8ce9-4b6d-9eb3-bda4c36f92c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5715d57-d1ec-4b01-8c32-379919788efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5715d57-d1ec-4b01-8c32-379919788efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-854403228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5126dff-40f7-4eb2-965d-b3d4fc2cb010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:15Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf2319d-c500-4a2b-a605-35d56973fc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf2319d-c500-4a2b-a605-35d56973fc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b22d6ae-cd74-490b-a3f8-1afd4333f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b22d6ae-cd74-490b-a3f8-1afd4333f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5126dff-40f7-4eb2-965d-b3d4fc2cb010', 'volume_name': 'volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247a6b1c-f0ec-4808-a490-eacace8779a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247a6b1c-f0ec-4808-a490-eacace8779a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab367946-c7c4-4c85-ac03-f1dab942aa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Volume c5126dff-40f7-4eb2-965d-b3d4fc2cb010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010', 'volume_size': 1} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-854403228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5126dff-40f7-4eb2-965d-b3d4fc2cb010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b9d286b46746838df24c02d2aba387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:15Z,use_quota=True,user_id='5fd3c63d7149496d8b2e477c64aeddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Creating volume c5126dff-40f7-4eb2-965d-b3d4fc2cb010 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:15 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:15 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 1073741824 Apr 24 01:16:15 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Flow 'volume_create_manager' (8d63db1e-613e-48b7-85f5-5b87622ed4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63df5101-e7cd-412c-a6fd-3e1d03625bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63df5101-e7cd-412c-a6fd-3e1d03625bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-418688905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2eb976-999b-41c1-8a2b-d4edbbd2dd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a1220a785f40e689a1758317ada000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:15Z,use_quota=True,user_id='2bf807e2f1c5457faf6ae65c9bc6b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630ecaf0-33df-4795-8969-2e201397d03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630ecaf0-33df-4795-8969-2e201397d03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ade3e5-a91d-4491-a379-c9bb278313f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ade3e5-a91d-4491-a379-c9bb278313f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e2eb976-999b-41c1-8a2b-d4edbbd2dd32', 'volume_name': 'volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4858b8-4137-45b8-b041-0c7b83ea55df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4858b8-4137-45b8-b041-0c7b83ea55df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a57e9b-f8eb-47d1-ad3e-7feb2d028764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:15 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Volume 4e2eb976-999b-41c1-8a2b-d4edbbd2dd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32', 'volume_size': 1} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:15 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 1073741824" returned: 0 in 0.577s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:15 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 Apr 24 01:16:15 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:16 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010" returned: 0 in 0.456s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-418688905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2eb976-999b-41c1-8a2b-d4edbbd2dd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a1220a785f40e689a1758317ada000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:15Z,use_quota=True,user_id='2bf807e2f1c5457faf6ae65c9bc6b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Creating volume 4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:16 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab367946-c7c4-4c85-ac03-f1dab942aa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:16 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 1073741824 Apr 24 01:16:16 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51708a73-ab6b-4b53-bfbd-e216a9cd5be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:16 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Volume volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 (c5126dff-40f7-4eb2-965d-b3d4fc2cb010): created successfully Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51708a73-ab6b-4b53-bfbd-e216a9cd5be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Flow 'volume_create_manager' (ce7bb544-8ce9-4b6d-9eb3-bda4c36f92c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:16 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9ffcc258-b543-4c51-b015-352ea34b035e tempest-VolumesActionsTest-578823602 None] Created volume successfully. Apr 24 01:16:16 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 1073741824" returned: 0 in 0.599s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:16 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 Apr 24 01:16:16 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:17 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" returned: 0 in 0.478s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a57e9b-f8eb-47d1-ad3e-7feb2d028764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7740ed-f188-4735-9550-8ece60c18e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:17 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Volume volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 (4e2eb976-999b-41c1-8a2b-d4edbbd2dd32): created successfully Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7740ed-f188-4735-9550-8ece60c18e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Flow 'volume_create_manager' (8d63db1e-613e-48b7-85f5-5b87622ed4e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:17 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-231ff0e6-8cce-4a6a-91c0-e4a69aa1f4d6 tempest-SnapshotMetadataTestJSON-1088966145 None] Created volume successfully. Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Acquiring lock "cinder-c5126dff-40f7-4eb2-965d-b3d4fc2cb010-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Lock "cinder-c5126dff-40f7-4eb2-965d-b3d4fc2cb010-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Acquiring lock "cinder-quobyte-c5126dff-40f7-4eb2-965d-b3d4fc2cb010" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Lock "cinder-quobyte-c5126dff-40f7-4eb2-965d-b3d4fc2cb010" acquired by "delete_volume" :: waited 0.013s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1112bfa7-f3df-4e90-9595-8988ec57dae2]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:17 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 Apr 24 01:16:17 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:18 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010" returned: 0 in 0.582s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:18 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010 Apr 24 01:16:18 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Creating offline snapshot 02b26fd2-4781-4514-b7c7-f98d7bfe5296 of volume 4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd8fae2-c54e-4c20-b72d-f11ae2a3c85f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:18 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 Apr 24 01:16:18 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:18 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5126dff-40f7-4eb2-965d-b3d4fc2cb010" returned: 0 in 0.555s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Lock "cinder-quobyte-c5126dff-40f7-4eb2-965d-b3d4fc2cb010" released by "delete_volume" :: held 1.183s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Created reservations ['74b942ef-351b-4929-93e9-152cc0729cb7', '97b350e1-5db7-4022-a3cd-89d487998a1a', '0deea164-8fab-4ffa-a37a-833a6aec1d2f', '994e7397-4712-47b4-bbec-fea043eee283'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:19 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" returned: 0 in 0.577s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:19 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 1G Apr 24 01:16:19 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:19 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:19 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:19 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.458s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:19 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Deleted volume successfully. Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1385031f-214d-4f36-8d3c-6e00a6309e91 tempest-VolumesActionsTest-578823602 None] Lock "cinder-c5126dff-40f7-4eb2-965d-b3d4fc2cb010-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:19 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 1G" returned: 0 in 0.651s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:19 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 Apr 24 01:16:19 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:20 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296" returned: 0 in 0.510s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:20 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 is being set with open permissions: ugo+rw Apr 24 01:16:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:20 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 Apr 24 01:16:20 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:20 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296" returned: 0 in 0.462s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:20 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=124,cinder:UPDATE=174,cinder:INSERT=48,cinder:DELETE=14 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:16:20 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=139,cinder:UPDATE=183,cinder:DELETE=16,cinder:INSERT=39 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:16:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:20 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.info Apr 24 01:16:20 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:21 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.info" returned: 0 in 0.512s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:21 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.info is being set with open permissions: ugo+rw Apr 24 01:16:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:21 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.info Apr 24 01:16:21 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:21 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.info" returned: 0 in 0.511s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.327s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-da2b22ff-a1c4-43bc-a60f-0c10b58743b8 tempest-SnapshotMetadataTestJSON-1088966145 None] Create snapshot completed successfully Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "cinder-02b26fd2-4781-4514-b7c7-f98d7bfe5296-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-02b26fd2-4781-4514-b7c7-f98d7bfe5296-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "cinder-quobyte-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-quobyte-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "cinder-quobyte-02b26fd2-4781-4514-b7c7-f98d7bfe5296" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-quobyte-02b26fd2-4781-4514-b7c7-f98d7bfe5296" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Deleting offline snapshot 02b26fd2-4781-4514-b7c7-f98d7bfe5296 of volume 4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] snapshot_file for this snap is: volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35777c8-b8dd-46be-bef0-6ed5daeba9ad]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:23 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 Apr 24 01:16:23 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:24 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296" returned: 0 in 0.580s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:16:24 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bf581b-fd0e-4340-b3db-1a304e645123]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:24 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 Apr 24 01:16:24 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:24 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" returned: 0 in 0.613s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:24 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 Apr 24 01:16:24 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:25 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296" returned: 0 in 0.602s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:25 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296 Apr 24 01:16:25 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:25 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32.02b26fd2-4781-4514-b7c7-f98d7bfe5296" returned: 0 in 0.457s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-quobyte-02b26fd2-4781-4514-b7c7-f98d7bfe5296" released by "_delete_snapshot" :: held 2.380s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-quobyte-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" released by "delete_snapshot" :: held 2.416s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:25 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Created reservations ['92fd43d2-2269-4d45-a6c9-dc36dec6d501', 'ee2dda2d-2a7c-41eb-ab46-2b68e93f9172', 'd52ea763-8866-49e4-a266-c3505516fc9d', 'c6b6be0c-adc5-4b8c-8455-23bc0e9e5c8e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:25 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Delete snapshot completed successfully. Apr 24 01:16:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-f16512be-5ea2-479e-8c02-9a2ea745fc61 tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-02b26fd2-4781-4514-b7c7-f98d7bfe5296-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "cinder-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "cinder-quobyte-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-quobyte-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:26 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd326dc5-60b7-4e7a-959b-a68556fe30f4]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:26 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 Apr 24 01:16:26 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:27 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" returned: 0 in 0.572s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:27 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32 Apr 24 01:16:27 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:27 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" returned: 0 in 0.513s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-quobyte-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32" released by "delete_volume" :: held 1.146s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Created reservations ['e7ca04b9-6c09-42d9-afc4-bfc8a3838dbb', '8c0ab40d-cdcf-478f-bc7b-4a2e58dd1fb9', '61031b21-f826-4f77-8d5b-64e6ff5245ea', '2b9f29cf-f419-4f78-960d-c1358b62280e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:28 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:28 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:28 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.557s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Deleted volume successfully. Apr 24 01:16:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-828f4e87-e819-44d8-ab5b-80bbc448be8c tempest-SnapshotMetadataTestJSON-1088966145 None] Lock "cinder-4e2eb976-999b-41c1-8a2b-d4edbbd2dd32-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Flow 'volume_create_manager' (e931fa87-2ad6-43e5-9023-8712c4c667e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f1c171-f190-4d5e-b6ea-6044c5ba3211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f1c171-f190-4d5e-b6ea-6044c5ba3211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2082676729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3238a3b-4df6-44f0-88ad-d218173ea2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eacd6debca954823997e74011164ed22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:31Z,use_quota=True,user_id='60f89c640efc4825bb756d1b7851633d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0680ec86-6788-4050-b5f2-4e3b60df4c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0680ec86-6788-4050-b5f2-4e3b60df4c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4cdc8a-477a-4f2c-b3d5-bbdf7b91f826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.image.glance [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Creating Keystone auth plugin from conf {{(pid=81925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4cdc8a-477a-4f2c-b3d5-bbdf7b91f826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3238a3b-4df6-44f0-88ad-d218173ea2fc', 'volume_name': 'volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4d1f4f-7535-433c-8735-e6909a008851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4d1f4f-7535-433c-8735-e6909a008851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1888ffa-6f81-406f-b82d-cb0eba218830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:31 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Volume e3238a3b-4df6-44f0-88ad-d218173ea2fc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 01:16:31 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Trying to clone e3238a3b-4df6-44f0-88ad-d218173ea2fc from image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]). {{(pid=81925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 01:16:32 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 01:16:32 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Image download 20.69 MB at 20.69 MB/s Apr 24 01:16:32 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e217fab-bbb1-42e5-b5cd-514db597257a]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:32 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD Apr 24 01:16:32 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:32 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:32 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Temporary image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 is fetched for user 60f89c640efc4825bb756d1b7851633d. {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 01:16:32 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b62c542-578c-4409-a6e8-c912ecd91b79]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:32 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD Apr 24 01:16:32 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:33 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2082676729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3238a3b-4df6-44f0-88ad-d218173ea2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eacd6debca954823997e74011164ed22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:31Z,use_quota=True,user_id='60f89c640efc4825bb756d1b7851633d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Creating volume e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:33 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:33 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc 1073741824 Apr 24 01:16:33 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Flow 'volume_create_manager' (7db9a76f-f3fa-45f2-9fb1-e12af51cfbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86111be-b63e-4424-8120-90232270b64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86111be-b63e-4424-8120-90232270b64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1068355417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=799dbca9-e7eb-4d8f-a7de-8a7a64649bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cca5b303d1f4b5f8f3c982dbfbb8a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:33Z,use_quota=True,user_id='a25120f963294a5d8554c14e5f90d650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24d3e96-4e66-4a05-9955-f99df1ac1ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24d3e96-4e66-4a05-9955-f99df1ac1ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1c8784-0939-460e-9901-3d14e9b99606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1c8784-0939-460e-9901-3d14e9b99606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '799dbca9-e7eb-4d8f-a7de-8a7a64649bb7', 'volume_name': 'volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829038e7-9081-43d6-937a-575cb26a2d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829038e7-9081-43d6-937a-575cb26a2d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002faf09-6fdd-4fbf-9a34-b09947b84211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:33 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Volume 799dbca9-e7eb-4d8f-a7de-8a7a64649bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7', 'volume_size': 1} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:33 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc 1073741824" returned: 0 in 0.607s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:33 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc Apr 24 01:16:33 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:34 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc" returned: 0 in 0.502s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.971s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1068355417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=799dbca9-e7eb-4d8f-a7de-8a7a64649bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cca5b303d1f4b5f8f3c982dbfbb8a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:33Z,use_quota=True,user_id='a25120f963294a5d8554c14e5f90d650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Creating volume 799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:34 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:34 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 1073741824 Apr 24 01:16:34 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Attempting download of a7c3cef6-73f5-4af2-9de8-0bc5792d6063 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}])) to volume e3238a3b-4df6-44f0-88ad-d218173ea2fc. {{(pid=81925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b185f6-bde5-4009-b10c-4994bd6bcd88]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_8xpfg56g {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:34 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_8xpfg56g Apr 24 01:16:34 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:35 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_8xpfg56g" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_8xpfg56g {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:35 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 1073741824" returned: 0 in 0.672s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:35 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_8xpfg56g Apr 24 01:16:35 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:35 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 Apr 24 01:16:35 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:35 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7" returned: 0 in 0.462s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002faf09-6fdd-4fbf-9a34-b09947b84211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71c1a34-2086-4763-8425-7f99338643cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:35 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_8xpfg56g" returned: 1 in 0.587s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_8xpfg56g' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a329ab-6989-42ed-b454-eab33bc45cea]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:35 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Volume volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 (799dbca9-e7eb-4d8f-a7de-8a7a64649bb7): created successfully Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71c1a34-2086-4763-8425-7f99338643cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Flow 'volume_create_manager' (7db9a76f-f3fa-45f2-9fb1-e12af51cfbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:35 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-359142f3-21e4-4ff0-939a-92aa8a26ff0b tempest-VolumesTransfersV357Test-58758964 None] Created volume successfully. Apr 24 01:16:35 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD Apr 24 01:16:35 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:36 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:36 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] a7c3cef6-73f5-4af2-9de8-0bc5792d6063 was qcow2, converting to raw {{(pid=81925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 01:16:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:36 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc Apr 24 01:16:36 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:37 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-dd4f3136-f959-4be0-9beb-9fbc688c4290 tempest-VolumesTransfersV357Test-1769086382 None] Transfer volume completed successfully. Apr 24 01:16:37 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc" returned: 0 in 1.565s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:37 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7c3cef6-73f5-4af2-9de8-0bc5792d6063_du6c2qtcdevstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:16:37 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Converted 112.00 MB image at 71.50 MB/s Apr 24 01:16:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:37 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc 1G Apr 24 01:16:37 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Acquiring lock "cinder-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Lock "cinder-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Acquiring lock "cinder-quobyte-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Lock "cinder-quobyte-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfaf7a6-9926-45a9-920b-f7c3fdc7fe64]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:38 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc 1G" returned: 0 in 0.600s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:38 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 Apr 24 01:16:38 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4526bdd7-dc74-44c1-87eb-6eef6008d915]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:38 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc Apr 24 01:16:38 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:38 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7" returned: 0 in 0.548s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:38 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7 Apr 24 01:16:38 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:39 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc" returned: 0 in 0.545s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:39 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc Apr 24 01:16:39 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:39 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7" returned: 0 in 0.423s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Lock "cinder-quobyte-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7" released by "delete_volume" :: held 1.021s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Created reservations ['2f838fdd-a994-4c51-a336-b66fdf459950', 'c790a53b-f399-451b-ba8b-69f9f87d51f5', '4de11c82-117b-442e-9b66-f0185f6e5bd5', '1bf13140-c3ff-4ec3-9827-922231971d32'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:39 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:39 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:39 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc" returned: 1 in 0.550s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Downloaded image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}])) to volume e3238a3b-4df6-44f0-88ad-d218173ea2fc successfully. {{(pid=81925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Temporary image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 for user 60f89c640efc4825bb756d1b7851633d is deleted. {{(pid=81925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.volume_utils [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Marking volume e3238a3b-4df6-44f0-88ad-d218173ea2fc as bootable. {{(pid=81925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Copying metadata from image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 to e3238a3b-4df6-44f0-88ad-d218173ea2fc. {{(pid=81925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Creating volume glance metadata for volume e3238a3b-4df6-44f0-88ad-d218173ea2fc backed by image a7c3cef6-73f5-4af2-9de8-0bc5792d6063 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1888ffa-6f81-406f-b82d-cb0eba218830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc', 'volume_size': 1, 'image_id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c28d319e58c24cfdbc4d64d62052bb0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7c3cef6-73f5-4af2-9de8-0bc5792d6063', 'created_at': datetime.datetime(2026, 4, 23, 23, 2, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 23, 23, 2, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7c3cef6-73f5-4af2-9de8-0bc5792d6063/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471e55a7-3944-4d6e-a6ab-acec7eb41501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:39 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Volume volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc (e3238a3b-4df6-44f0-88ad-d218173ea2fc): created successfully Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471e55a7-3944-4d6e-a6ab-acec7eb41501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Flow 'volume_create_manager' (e931fa87-2ad6-43e5-9023-8712c4c667e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:39 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c8aed963-2ec2-45f5-badf-d1cf7188f4a7 tempest-VolumesImageMetadata-2118520568 None] Created volume successfully. Apr 24 01:16:39 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.445s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:39 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Deleted volume successfully. Apr 24 01:16:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9e557323-e810-47a5-bc4c-672286530c4d tempest-VolumesTransfersV357Test-654719329 None] Lock "cinder-799dbca9-e7eb-4d8f-a7de-8a7a64649bb7-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Flow 'volume_create_manager' (a2441eff-75ff-4cfb-bfb6-ee1f481119de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a897e7c2-15d9-41c1-88a6-68075607f425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a897e7c2-15d9-41c1-88a6-68075607f425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1035493656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aaa2301-eaa3-4109-a0f4-f546a9c9c125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cca5b303d1f4b5f8f3c982dbfbb8a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:41Z,use_quota=True,user_id='a25120f963294a5d8554c14e5f90d650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318b07bd-6085-4fee-811c-e5682596033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318b07bd-6085-4fee-811c-e5682596033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6306d0a6-ebaa-4399-8c06-cde36e394523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6306d0a6-ebaa-4399-8c06-cde36e394523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aaa2301-eaa3-4109-a0f4-f546a9c9c125', 'volume_name': 'volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7946ec6f-dd63-4089-b4f7-7df314ab3d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7946ec6f-dd63-4089-b4f7-7df314ab3d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c09dd8d-3f15-4ef3-b69f-03ffb45c6219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:40 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Volume 1aaa2301-eaa3-4109-a0f4-f546a9c9c125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125', 'volume_size': 1} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1035493656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aaa2301-eaa3-4109-a0f4-f546a9c9c125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cca5b303d1f4b5f8f3c982dbfbb8a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:41Z,use_quota=True,user_id='a25120f963294a5d8554c14e5f90d650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Creating volume 1aaa2301-eaa3-4109-a0f4-f546a9c9c125 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:40 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:40 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 1073741824 Apr 24 01:16:40 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Acquiring lock "cinder-e3238a3b-4df6-44f0-88ad-d218173ea2fc-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Lock "cinder-e3238a3b-4df6-44f0-88ad-d218173ea2fc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Acquiring lock "cinder-quobyte-e3238a3b-4df6-44f0-88ad-d218173ea2fc" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Lock "cinder-quobyte-e3238a3b-4df6-44f0-88ad-d218173ea2fc" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f15bb67-6c20-43c5-94f1-fdff102b6bfe]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:41 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc Apr 24 01:16:41 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:41 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 1073741824" returned: 0 in 0.673s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:41 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 Apr 24 01:16:41 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:41 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc" returned: 0 in 0.580s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:41 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc Apr 24 01:16:41 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:42 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125" returned: 0 in 0.441s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c09dd8d-3f15-4ef3-b69f-03ffb45c6219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0679073-d1ea-452f-bfff-8f47493be342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:42 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Volume volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 (1aaa2301-eaa3-4109-a0f4-f546a9c9c125): created successfully Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0679073-d1ea-452f-bfff-8f47493be342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Flow 'volume_create_manager' (a2441eff-75ff-4cfb-bfb6-ee1f481119de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:42 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-3b8afa14-a6ee-4611-92a7-39b92ce2dade tempest-VolumesTransfersV357Test-58758964 None] Created volume successfully. Apr 24 01:16:42 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc" returned: 1 in 0.538s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:42 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc Apr 24 01:16:42 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:42 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e3238a3b-4df6-44f0-88ad-d218173ea2fc" returned: 0 in 0.476s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Lock "cinder-quobyte-e3238a3b-4df6-44f0-88ad-d218173ea2fc" released by "delete_volume" :: held 1.653s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:42 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Created reservations ['cb44e050-0fd9-4363-9e66-246e78e6835c', '20ac3f31-722b-4cf3-9521-0db292eb7bae', '1eb63087-92da-48e3-a33d-4900ffbcf3db', 'bbd1b4e1-7618-4d85-8bac-8c363f2745b4'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:43 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:43 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:43 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.518s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:43 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Deleted volume successfully. Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-5dd5f6c1-a369-4872-843c-ad5a61ac41a9 tempest-VolumesImageMetadata-2118520568 None] Lock "cinder-e3238a3b-4df6-44f0-88ad-d218173ea2fc-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Acquiring lock "cinder-1aaa2301-eaa3-4109-a0f4-f546a9c9c125-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Lock "cinder-1aaa2301-eaa3-4109-a0f4-f546a9c9c125-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Acquiring lock "cinder-quobyte-1aaa2301-eaa3-4109-a0f4-f546a9c9c125" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Lock "cinder-quobyte-1aaa2301-eaa3-4109-a0f4-f546a9c9c125" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[42840aff-2bb5-4211-8c05-f07de328c890]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:43 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 Apr 24 01:16:43 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:44 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125" returned: 0 in 0.640s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:44 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125 Apr 24 01:16:44 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:44 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1aaa2301-eaa3-4109-a0f4-f546a9c9c125" returned: 0 in 0.552s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Lock "cinder-quobyte-1aaa2301-eaa3-4109-a0f4-f546a9c9c125" released by "delete_volume" :: held 1.235s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:44 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Created reservations ['21c26c17-9f27-41a9-82cd-59eaa76ad53c', '0b49683d-54e9-4e11-9475-8319e2a36347', '45e48369-f6aa-4f81-96d7-0ac201be6830', '059e56e2-1857-4dc1-930c-a010e0574c98'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:45 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:45 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:45 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:45 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Deleted volume successfully. Apr 24 01:16:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c18b8c68-a84f-4ec6-abca-f2c55d88b839 tempest-VolumesTransfersV357Test-654719329 None] Lock "cinder-1aaa2301-eaa3-4109-a0f4-f546a9c9c125-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Flow 'volume_create_manager' (12a43b67-1e1e-4a90-ba8d-f83ec90259a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687611e9-7ab9-4437-b8f8-bc7342810858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687611e9-7ab9-4437-b8f8-bc7342810858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-965370553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f1c131-b43b-4c77-a6ff-06e1dfecb819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd746838b276494d9fe06468b1264762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:46Z,use_quota=True,user_id='b0113ff5017b4270b9593e685065ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336637bf-19b0-4ba3-ae20-0de0bc7b1c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336637bf-19b0-4ba3-ae20-0de0bc7b1c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2d3d19-4e6d-49ef-a001-683c8677ede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2d3d19-4e6d-49ef-a001-683c8677ede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f1c131-b43b-4c77-a6ff-06e1dfecb819', 'volume_name': 'volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebec19c-9a0c-43b4-9aee-0bda7d4e82e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebec19c-9a0c-43b4-9aee-0bda7d4e82e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74f057a-6bfe-40fd-9d0b-b3ad38f184ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:46 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Volume 24f1c131-b43b-4c77-a6ff-06e1dfecb819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819', 'volume_size': 1} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-965370553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f1c131-b43b-4c77-a6ff-06e1dfecb819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd746838b276494d9fe06468b1264762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:46Z,use_quota=True,user_id='b0113ff5017b4270b9593e685065ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Creating volume 24f1c131-b43b-4c77-a6ff-06e1dfecb819 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:46 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:46 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 1073741824 Apr 24 01:16:46 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:47 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 1073741824" returned: 0 in 0.723s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:47 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 Apr 24 01:16:47 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:47 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819" returned: 0 in 0.473s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74f057a-6bfe-40fd-9d0b-b3ad38f184ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b52776a-4e33-49db-821e-98904202c9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:47 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Volume volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 (24f1c131-b43b-4c77-a6ff-06e1dfecb819): created successfully Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b52776a-4e33-49db-821e-98904202c9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Flow 'volume_create_manager' (12a43b67-1e1e-4a90-ba8d-f83ec90259a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-29448190-1dcd-4898-9b61-2b316bfb1c82 tempest-VolumesMetadataTest-432050289 None] Created volume successfully. Apr 24 01:16:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Acquiring lock "cinder-24f1c131-b43b-4c77-a6ff-06e1dfecb819-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Lock "cinder-24f1c131-b43b-4c77-a6ff-06e1dfecb819-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Acquiring lock "cinder-quobyte-24f1c131-b43b-4c77-a6ff-06e1dfecb819" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:16:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Lock "cinder-quobyte-24f1c131-b43b-4c77-a6ff-06e1dfecb819" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:16:49 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a8623e-f863-4a35-88bd-c0950eded287]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:49 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 Apr 24 01:16:49 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:49 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819" returned: 0 in 0.581s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:49 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819 Apr 24 01:16:49 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:50 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-24f1c131-b43b-4c77-a6ff-06e1dfecb819" returned: 0 in 0.503s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Lock "cinder-quobyte-24f1c131-b43b-4c77-a6ff-06e1dfecb819" released by "delete_volume" :: held 1.145s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Created reservations ['917e25ea-7368-4b89-b1ca-d7975c9f4221', '09f62494-aa98-4bf8-a24e-bd2383fac178', '4446ae87-7b90-4bab-8940-5da62535efd7', '6deca9e8-8884-4a95-97f8-aa0f1e3ec3f5'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:50 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:16:50 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:51 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.481s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:51 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:16:51 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Deleted volume successfully. Apr 24 01:16:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-08b76c9c-5e30-4d52-af64-05344313fca5 tempest-VolumesMetadataTest-432050289 None] Lock "cinder-24f1c131-b43b-4c77-a6ff-06e1dfecb819-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Flow 'volume_create_manager' (e7fc58c9-cb07-427e-b7ef-fea2313b8a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5197f6ff-ea7b-4200-afab-adbdfef8ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5197f6ff-ea7b-4200-afab-adbdfef8ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2012379301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99f885c-cc52-4051-88e3-611223077e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc52b6076274b04ad0900ad6ca52187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:53Z,use_quota=True,user_id='75f131a87a1d4bada0e89201ac73d1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ff824e-e1ba-47bb-aeaa-fd93c39e7d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ff824e-e1ba-47bb-aeaa-fd93c39e7d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa41bee-16a4-4d47-b11d-bcb6c9c74cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa41bee-16a4-4d47-b11d-bcb6c9c74cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99f885c-cc52-4051-88e3-611223077e92', 'volume_name': 'volume-d99f885c-cc52-4051-88e3-611223077e92', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa80c3bd-1739-4d5a-98d3-9eb2c5618b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa80c3bd-1739-4d5a-98d3-9eb2c5618b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2071af0c-3524-4865-9e78-94982dcb53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:53 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Volume d99f885c-cc52-4051-88e3-611223077e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99f885c-cc52-4051-88e3-611223077e92', 'volume_size': 1} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2012379301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99f885c-cc52-4051-88e3-611223077e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc52b6076274b04ad0900ad6ca52187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:16:53Z,use_quota=True,user_id='75f131a87a1d4bada0e89201ac73d1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Creating volume d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:16:53 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:16:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:53 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 1073741824 Apr 24 01:16:53 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:54 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 1073741824" returned: 0 in 0.742s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:54 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 Apr 24 01:16:54 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:54 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92" returned: 0 in 0.551s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2071af0c-3524-4865-9e78-94982dcb53a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99f885c-cc52-4051-88e3-611223077e92', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35320f0e-32d9-42a4-a5c3-c076779ec93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:16:54 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Volume volume-d99f885c-cc52-4051-88e3-611223077e92 (d99f885c-cc52-4051-88e3-611223077e92): created successfully Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35320f0e-32d9-42a4-a5c3-c076779ec93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:16:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Flow 'volume_create_manager' (e7fc58c9-cb07-427e-b7ef-fea2313b8a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:16:54 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1ae6126e-e079-4dcd-9fc4-329e7fcd5750 tempest-VolumesSnapshotListTestJSON-2030707792 None] Created volume successfully. Apr 24 01:16:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:16:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:16:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Creating offline snapshot 2e40c1b8-130c-4dea-9e1a-fe134ca54762 of volume d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:16:55 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa71182b-eed1-4156-bc0d-d8868dce7f33]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:16:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:55 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 Apr 24 01:16:55 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:56 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92" returned: 0 in 0.565s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:56 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 1G Apr 24 01:16:56 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:57 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 1G" returned: 0 in 0.639s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:57 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 Apr 24 01:16:57 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:57 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762" returned: 0 in 0.528s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:57 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 is being set with open permissions: ugo+rw Apr 24 01:16:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:57 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 Apr 24 01:16:57 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:58 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762" returned: 0 in 0.435s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:58 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.info Apr 24 01:16:58 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:58 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.info" returned: 0 in 0.508s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:58 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.info is being set with open permissions: ugo+rw Apr 24 01:16:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:16:58 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.info Apr 24 01:16:58 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:16:59 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 24 01:16:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.info" returned: 0 in 0.477s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:16:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.247s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:16:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0c475d05-0301-4c0f-a021-ce14cd40370c tempest-VolumesSnapshotListTestJSON-2030707792 None] Create snapshot completed successfully Apr 24 01:17:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Creating offline snapshot 224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 of volume d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:17:00 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b419c-118e-4f09-ab97-c3a6d8140988]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:00 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 Apr 24 01:17:00 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:00 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762" returned: 0 in 0.596s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99f885c-cc52-4051-88e3-611223077e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:17:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:00 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 1G Apr 24 01:17:00 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:01 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 1G" returned: 0 in 0.721s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:01 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 Apr 24 01:17:01 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:02 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" returned: 0 in 0.688s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:02 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 is being set with open permissions: ugo+rw Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:02 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 Apr 24 01:17:02 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:02 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" returned: 0 in 0.531s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Flow 'volume_create_manager' (d50dec0d-163a-4f56-aff4-829dffb4b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7442f109-02c1-44a3-90d2-3111b920569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:02 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-66d1a76b-59a8-40e6-ad58-8b6af7d6fd5a tempest-VolumesSnapshotListTestJSON-2030707792 None] Create snapshot completed successfully Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7442f109-02c1-44a3-90d2-3111b920569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755958982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e8b8e4-ad6c-4548-8804-ba1287cb2ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856c09ae283648cbaf70ccf10fdb61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:03Z,use_quota=True,user_id='e4944c6a411b4f76be64c398e30244f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12af9e76-3204-4d71-a7d6-ab091fd11578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12af9e76-3204-4d71-a7d6-ab091fd11578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bba422-5c7c-4eb5-9129-448db38a463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bba422-5c7c-4eb5-9129-448db38a463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e8b8e4-ad6c-4548-8804-ba1287cb2ece', 'volume_name': 'volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31699e54-4c67-4c62-b8c8-e649f7be880b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31699e54-4c67-4c62-b8c8-e649f7be880b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b9f92c-de38-477b-956a-96be59fb2fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:03 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Volume c5e8b8e4-ad6c-4548-8804-ba1287cb2ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece', 'volume_size': 1} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755958982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e8b8e4-ad6c-4548-8804-ba1287cb2ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856c09ae283648cbaf70ccf10fdb61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:03Z,use_quota=True,user_id='e4944c6a411b4f76be64c398e30244f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Creating volume c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:03 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:03 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece 1073741824 Apr 24 01:17:03 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:03 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece 1073741824" returned: 0 in 0.669s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:03 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:17:03 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:04 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.436s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.611s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b9f92c-de38-477b-956a-96be59fb2fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd463a4e-4686-425f-9ce1-55a875ab62f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Creating offline snapshot e35b564f-023c-41d6-a3d4-6e3ba66ab852 of volume d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:17:04 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Volume volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece (c5e8b8e4-ad6c-4548-8804-ba1287cb2ece): created successfully Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd463a4e-4686-425f-9ce1-55a875ab62f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Flow 'volume_create_manager' (d50dec0d-163a-4f56-aff4-829dffb4b499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc879dec-0fdd-4a38-ae60-f7cab6cb7759]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:04 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d9edcb16-58e7-4f9c-bf6a-54e4d84cbd2b tempest-VolumesActionsTest-445014549 None] Created volume successfully. Apr 24 01:17:04 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 Apr 24 01:17:04 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:04 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" returned: 0 in 0.528s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99f885c-cc52-4051-88e3-611223077e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:17:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:04 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 1G Apr 24 01:17:04 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:05 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 1G" returned: 0 in 0.725s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:05 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 Apr 24 01:17:05 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:06 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852" returned: 0 in 0.562s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:06 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 is being set with open permissions: ugo+rw Apr 24 01:17:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:06 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 Apr 24 01:17:06 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:06 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-364dd9e2-603b-4442-b786-a92e502dc82a tempest-VolumesSnapshotListTestJSON-2030707792 None] Create snapshot completed successfully Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-e35b564f-023c-41d6-a3d4-6e3ba66ab852-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-e35b564f-023c-41d6-a3d4-6e3ba66ab852-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-quobyte-e35b564f-023c-41d6-a3d4-6e3ba66ab852" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-e35b564f-023c-41d6-a3d4-6e3ba66ab852" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Deleting offline snapshot e35b564f-023c-41d6-a3d4-6e3ba66ab852 of volume d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] snapshot_file for this snap is: volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3609569b-f0ad-433e-a7f8-f717b112e6a7]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:08 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 Apr 24 01:17:08 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:09 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852" returned: 0 in 0.574s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99f885c-cc52-4051-88e3-611223077e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:17:09 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a16a7-9747-4834-80b6-14b54eeab6e1]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:09 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 Apr 24 01:17:09 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:09 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" returned: 0 in 0.535s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99f885c-cc52-4051-88e3-611223077e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:17:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:09 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 Apr 24 01:17:09 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:10 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852" returned: 0 in 0.712s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:10 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852 Apr 24 01:17:10 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:11 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.e35b564f-023c-41d6-a3d4-6e3ba66ab852" returned: 0 in 0.498s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-e35b564f-023c-41d6-a3d4-6e3ba66ab852" released by "_delete_snapshot" :: held 2.424s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" released by "delete_snapshot" :: held 2.448s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Created reservations ['54bd891f-f91e-4222-a803-259b0f54d8bb', 'e2bfddda-fa03-47e6-91a0-caf1a2729ab5', 'fba9f797-f9a8-4d2b-ae22-18fc5c3f60e4', 'a1dddea0-c61b-410d-b6f9-b88ebbb37372'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:11 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Delete snapshot completed successfully. Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9b332a9c-9316-4246-b5cf-290f0876d089 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-e35b564f-023c-41d6-a3d4-6e3ba66ab852-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:11 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:11 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-224728d7-7f4c-4bf1-a5a5-bf75f3abdca1-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-224728d7-7f4c-4bf1-a5a5-bf75f3abdca1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-quobyte-224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Deleting offline snapshot 224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 of volume d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] snapshot_file for this snap is: volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa9055-0a5e-4920-a524-07631ad4d514]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:12 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 Apr 24 01:17:12 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:12 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.558s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:12 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" returned: 0 in 0.637s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99f885c-cc52-4051-88e3-611223077e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2dd10b-4ddd-40f1-af26-89496bb4688e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:12 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 Apr 24 01:17:12 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:13 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762" returned: 0 in 0.593s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:13 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99f885c-cc52-4051-88e3-611223077e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:17:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:13 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 Apr 24 01:17:13 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:13 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" returned: 0 in 0.624s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:13 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1 Apr 24 01:17:13 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:14 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" returned: 0 in 0.489s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-224728d7-7f4c-4bf1-a5a5-bf75f3abdca1" released by "_delete_snapshot" :: held 2.455s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" released by "delete_snapshot" :: held 2.480s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:14 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Created reservations ['fb0871f6-5ac0-4799-b6ab-60c08d2cacc7', '1fc389ba-517a-44ec-ba7c-fd26e3fbc82a', '9106c25d-9953-4004-902b-c5ee446199d4', 'a190db48-7bef-45f3-a0ab-b64906769c32'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:14 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Delete snapshot completed successfully. Apr 24 01:17:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1acd9fc7-d068-4b93-93a4-6a5ec43a6b33 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-224728d7-7f4c-4bf1-a5a5-bf75f3abdca1-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-2e40c1b8-130c-4dea-9e1a-fe134ca54762-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-2e40c1b8-130c-4dea-9e1a-fe134ca54762-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-quobyte-2e40c1b8-130c-4dea-9e1a-fe134ca54762" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-2e40c1b8-130c-4dea-9e1a-fe134ca54762" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Deleting offline snapshot 2e40c1b8-130c-4dea-9e1a-fe134ca54762 of volume d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] snapshot_file for this snap is: volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d3fbf-730a-4cad-a6ef-a9be535a8908]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:15 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 Apr 24 01:17:15 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:15 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762" returned: 0 in 0.594s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99f885c-cc52-4051-88e3-611223077e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a80ff-ec8c-4054-a6e6-071c10be5a42]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:15 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 Apr 24 01:17:15 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:16 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92" returned: 0 in 0.578s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:16 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 Apr 24 01:17:16 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:16 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762" returned: 0 in 0.558s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:17 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762 Apr 24 01:17:17 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:17 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92.2e40c1b8-130c-4dea-9e1a-fe134ca54762" returned: 0 in 0.442s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-2e40c1b8-130c-4dea-9e1a-fe134ca54762" released by "_delete_snapshot" :: held 2.277s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" released by "delete_snapshot" :: held 2.305s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:17 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Created reservations ['849184ea-a4d9-4046-9141-87112647a010', 'f2c8c61a-a77e-48e2-b74f-e2877c69a6da', '44bad90b-1657-4224-8fe3-1210d89d8cff', '5b46d757-a428-4d13-addf-79a24064ac9f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:17 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Delete snapshot completed successfully. Apr 24 01:17:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c74eb5d0-587f-40b0-977d-91be24250c03 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-2e40c1b8-130c-4dea-9e1a-fe134ca54762-delete_snapshot" released by "delete_snapshot" :: held 2.445s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-d99f885c-cc52-4051-88e3-611223077e92-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-d99f885c-cc52-4051-88e3-611223077e92-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:18 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[057bb679-d1e9-4960-b7f3-50b06d053c6d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:18 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 Apr 24 01:17:18 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:19 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92" returned: 0 in 0.713s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:19 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92 Apr 24 01:17:19 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:19 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d99f885c-cc52-4051-88e3-611223077e92" returned: 0 in 0.614s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-quobyte-d99f885c-cc52-4051-88e3-611223077e92" released by "delete_volume" :: held 1.393s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:19 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Created reservations ['48aef15b-a395-49ce-8372-b725937d653d', '454a3a03-c5c3-4bfb-a9f0-cc1ff67249f9', '00ed6da7-b453-4adc-975a-e30ba13df041', '51dd806d-1920-41e1-9ac2-d1e3f198b968'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:20 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:20 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:20 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.455s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:20 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Deleted volume successfully. Apr 24 01:17:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-caee4378-f647-49ba-ab92-f161731e4641 tempest-VolumesSnapshotListTestJSON-2030707792 None] Lock "cinder-d99f885c-cc52-4051-88e3-611223077e92-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13ed3751-c76a-4526-8c4b-72c22861e794 tempest-VolumesActionsTest-445014549 None] Acquiring lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" by "attach_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13ed3751-c76a-4526-8c4b-72c22861e794 tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" acquired by "attach_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:22 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=76,cinder:UPDATE=96,cinder:INSERT=27,cinder:DELETE=7 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:17:22 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=93,cinder:SELECT=86,cinder:INSERT=35,cinder:DELETE=9 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:17:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-13ed3751-c76a-4526-8c4b-72c22861e794 tempest-VolumesActionsTest-445014549 None] Attaching volume c5e8b8e4-ad6c-4548-8804-ba1287cb2ece to instance 14ef8073-65b2-4268-bac4-2d54a32d66aa at mountpoint /dev/vdb on host None. Apr 24 01:17:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-13ed3751-c76a-4526-8c4b-72c22861e794 tempest-VolumesActionsTest-445014549 None] Attach volume completed successfully. Apr 24 01:17:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-13ed3751-c76a-4526-8c4b-72c22861e794 tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" released by "attach_volume" :: held 0.198s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6dad22d-8f4a-42ab-b80c-f3252772a55d tempest-VolumesActionsTest-445014549 None] Acquiring lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-detach_volume" by "detach_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6dad22d-8f4a-42ab-b80c-f3252772a55d tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a6dad22d-8f4a-42ab-b80c-f3252772a55d tempest-VolumesActionsTest-445014549 None] Detaching volume c5e8b8e4-ad6c-4548-8804-ba1287cb2ece from instance 14ef8073-65b2-4268-bac4-2d54a32d66aa. Apr 24 01:17:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a6dad22d-8f4a-42ab-b80c-f3252772a55d tempest-VolumesActionsTest-445014549 None] Detach volume completed successfully. Apr 24 01:17:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6dad22d-8f4a-42ab-b80c-f3252772a55d tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (47c08e34-41aa-4c48-9e45-76fabb936fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2ea0b1-585e-4162-83f0-33d62be2db9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2ea0b1-585e-4162-83f0-33d62be2db9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2013150828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6ea15f-5157-449c-84fa-71e1c70a22e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:23Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee17cd7a-b257-4eee-88a7-43824d2d7c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee17cd7a-b257-4eee-88a7-43824d2d7c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a34553f-efd9-479b-863e-353fef55a3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a34553f-efd9-479b-863e-353fef55a3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6ea15f-5157-449c-84fa-71e1c70a22e3', 'volume_name': 'volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de747d4-34c9-462e-8cf6-2c0ec4a756ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de747d4-34c9-462e-8cf6-2c0ec4a756ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a6583d-c866-4464-b593-ada9ec2d20e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Volume 0c6ea15f-5157-449c-84fa-71e1c70a22e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3', 'volume_size': 1} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2013150828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6ea15f-5157-449c-84fa-71e1c70a22e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:23Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Creating volume 0c6ea15f-5157-449c-84fa-71e1c70a22e3 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:23 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:23 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 1073741824 Apr 24 01:17:23 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (a961aa8b-9385-4572-9cf7-3edcc8221cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040ae8ef-1ea7-43c0-9d5e-94a5fb221b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040ae8ef-1ea7-43c0-9d5e-94a5fb221b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264314486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e3ee33-d302-4522-b91f-1fa0cd845095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:24Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc0f697-c741-49d0-aab3-0740c015007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc0f697-c741-49d0-aab3-0740c015007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd2167a-0ce2-4854-8a7f-3a60f3ba4f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd2167a-0ce2-4854-8a7f-3a60f3ba4f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e3ee33-d302-4522-b91f-1fa0cd845095', 'volume_name': 'volume-25e3ee33-d302-4522-b91f-1fa0cd845095', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2412654-bcf4-4d3c-b309-fc8f9e7999fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2412654-bcf4-4d3c-b309-fc8f9e7999fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9dbd03-ead2-4579-918d-5a5faa76a246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:23 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Volume 25e3ee33-d302-4522-b91f-1fa0cd845095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e3ee33-d302-4522-b91f-1fa0cd845095', 'volume_size': 1} Apr 24 01:17:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (6b198b3f-e332-489c-bea2-31e1de5a358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f03dbb3-dc23-4735-b452-f55c6da04900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f03dbb3-dc23-4735-b452-f55c6da04900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1033338346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ce47ff-3096-4fc5-a590-04a6e711ced1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:24Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5938ba06-0aad-4c81-a405-605dc27aef19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5938ba06-0aad-4c81-a405-605dc27aef19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaa8cde-def4-4acf-9629-2c5ba72cad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaa8cde-def4-4acf-9629-2c5ba72cad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ce47ff-3096-4fc5-a590-04a6e711ced1', 'volume_name': 'volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7539f68-7afc-4be7-82e3-8c4ac542b46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7539f68-7afc-4be7-82e3-8c4ac542b46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb216d8-6779-4219-8133-2157e05e77eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Volume e4ce47ff-3096-4fc5-a590-04a6e711ced1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1', 'volume_size': 1} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:24 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 1073741824" returned: 0 in 1.006s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (fe65e774-2fa2-4689-aae4-2cd03f2b0537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204dfb42-0a31-4108-808d-a599afe03428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 Apr 24 01:17:24 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204dfb42-0a31-4108-808d-a599afe03428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408934703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5d88f1-237a-4264-85c5-8cc4e260e040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:24Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b289d2f9-3769-4b1c-9f51-6862b420352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b289d2f9-3769-4b1c-9f51-6862b420352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa9c4be-34d5-4aa9-aec4-fa0cf8271176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa9c4be-34d5-4aa9-aec4-fa0cf8271176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c5d88f1-237a-4264-85c5-8cc4e260e040', 'volume_name': 'volume-2c5d88f1-237a-4264-85c5-8cc4e260e040', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7f7338-e662-4460-9216-b4efc1fac30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7f7338-e662-4460-9216-b4efc1fac30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d2ab35-cca4-46e9-8f09-415f8e492265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Volume 2c5d88f1-237a-4264-85c5-8cc4e260e040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c5d88f1-237a-4264-85c5-8cc4e260e040', 'volume_size': 1} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (e12fb1c4-b62b-4a83-be3c-28fddb61e3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca287483-d117-41c0-9582-05d9389974d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca287483-d117-41c0-9582-05d9389974d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-408573983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0ad4a9-a502-46c7-bf25-229f067313d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:25Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f677bde8-d652-4ba4-9f2b-4c9c72358263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f677bde8-d652-4ba4-9f2b-4c9c72358263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bac2a5-313f-45af-9ff2-2503732484d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bac2a5-313f-45af-9ff2-2503732484d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0ad4a9-a502-46c7-bf25-229f067313d3', 'volume_name': 'volume-5a0ad4a9-a502-46c7-bf25-229f067313d3', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d931029b-6990-43ed-92e7-b236c86dd37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d931029b-6990-43ed-92e7-b236c86dd37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5afff87-e3ea-47ae-b1c1-c2508dd56dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Volume 5a0ad4a9-a502-46c7-bf25-229f067313d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0ad4a9-a502-46c7-bf25-229f067313d3', 'volume_size': 1} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:25 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3" returned: 0 in 0.836s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.433s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264314486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e3ee33-d302-4522-b91f-1fa0cd845095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:24Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Creating volume 25e3ee33-d302-4522-b91f-1fa0cd845095 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:25 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:25 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 1073741824 Apr 24 01:17:25 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a6583d-c866-4464-b593-ada9ec2d20e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c67b1f-c595-4d40-aaa3-333cbab5695a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Volume volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 (0c6ea15f-5157-449c-84fa-71e1c70a22e3): created successfully Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c67b1f-c595-4d40-aaa3-333cbab5695a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (47c08e34-41aa-4c48-9e45-76fabb936fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:25 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2ddad6c9-e57a-4061-8877-94d949d2fc7b tempest-CreateVolumesFromImageTest-1960286033 None] Created volume successfully. Apr 24 01:17:26 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 1073741824" returned: 0 in 0.649s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:26 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 Apr 24 01:17:26 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:26 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095" returned: 0 in 0.472s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.274s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1033338346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ce47ff-3096-4fc5-a590-04a6e711ced1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:24Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Creating volume e4ce47ff-3096-4fc5-a590-04a6e711ced1 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:26 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9dbd03-ead2-4579-918d-5a5faa76a246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e3ee33-d302-4522-b91f-1fa0cd845095', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:26 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 1073741824 Apr 24 01:17:26 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdbce2c8-a2ad-4984-8047-ca900b5c0445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:26 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Volume volume-25e3ee33-d302-4522-b91f-1fa0cd845095 (25e3ee33-d302-4522-b91f-1fa0cd845095): created successfully Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdbce2c8-a2ad-4984-8047-ca900b5c0445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:26 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (a961aa8b-9385-4572-9cf7-3edcc8221cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:26 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-6de44802-fe57-49ec-8071-0ac31ebfeb9a tempest-CreateVolumesFromImageTest-1960286033 None] Created volume successfully. Apr 24 01:17:27 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 1073741824" returned: 0 in 0.665s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:27 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 Apr 24 01:17:27 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:27 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1" returned: 0 in 0.445s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.985s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408934703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5d88f1-237a-4264-85c5-8cc4e260e040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:24Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Creating volume 2c5d88f1-237a-4264-85c5-8cc4e260e040 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:27 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:27 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 1073741824 Apr 24 01:17:27 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb216d8-6779-4219-8133-2157e05e77eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf85ca1-771b-4203-8177-1ce221b5d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:27 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Volume volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 (e4ce47ff-3096-4fc5-a590-04a6e711ced1): created successfully Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf85ca1-771b-4203-8177-1ce221b5d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (6b198b3f-e332-489c-bea2-31e1de5a358a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:27 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0870c0df-bf3a-4922-80a4-a32bbad40284 tempest-CreateVolumesFromImageTest-1960286033 None] Created volume successfully. Apr 24 01:17:28 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 1073741824" returned: 0 in 0.619s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:28 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 Apr 24 01:17:28 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:28 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040" returned: 0 in 0.420s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.730s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-408573983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0ad4a9-a502-46c7-bf25-229f067313d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7668fd23ac2e474d9e1687ae9bcc08c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:25Z,use_quota=True,user_id='b1132ef257af40d6a104f6d5c8f47aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Creating volume 5a0ad4a9-a502-46c7-bf25-229f067313d3 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:28 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:28 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 1073741824 Apr 24 01:17:28 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d2ab35-cca4-46e9-8f09-415f8e492265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5d88f1-237a-4264-85c5-8cc4e260e040', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2005f710-52b9-4957-be79-d497916647de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:28 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Volume volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 (2c5d88f1-237a-4264-85c5-8cc4e260e040): created successfully Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2005f710-52b9-4957-be79-d497916647de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (fe65e774-2fa2-4689-aae4-2cd03f2b0537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5346f314-181a-4d26-b6d3-3530f519ae86 tempest-CreateVolumesFromImageTest-1960286033 None] Created volume successfully. Apr 24 01:17:29 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 1073741824" returned: 0 in 0.623s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:29 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 Apr 24 01:17:29 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:29 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3" returned: 0 in 0.461s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5afff87-e3ea-47ae-b1c1-c2508dd56dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0ad4a9-a502-46c7-bf25-229f067313d3', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27c0383-5d59-465c-8694-9f94bf1f53f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:29 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Volume volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 (5a0ad4a9-a502-46c7-bf25-229f067313d3): created successfully Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27c0383-5d59-465c-8694-9f94bf1f53f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Flow 'volume_create_manager' (e12fb1c4-b62b-4a83-be3c-28fddb61e3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4b1415c9-69b3-4196-b56f-8100ef53b8c5 tempest-CreateVolumesFromImageTest-1960286033 None] Created volume successfully. Apr 24 01:17:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-5a0ad4a9-a502-46c7-bf25-229f067313d3-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-5a0ad4a9-a502-46c7-bf25-229f067313d3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-quobyte-5a0ad4a9-a502-46c7-bf25-229f067313d3" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-5a0ad4a9-a502-46c7-bf25-229f067313d3" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:30 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9bd313-86d3-4c6a-a463-2572e9fa6a9e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:30 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 Apr 24 01:17:30 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:31 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3" returned: 0 in 0.514s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:31 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3 Apr 24 01:17:31 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:31 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-5a0ad4a9-a502-46c7-bf25-229f067313d3" returned: 0 in 0.533s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-5a0ad4a9-a502-46c7-bf25-229f067313d3" released by "delete_volume" :: held 1.090s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Created reservations ['40db29f4-286b-4ba1-84e7-6fb26d83c665', 'de3975a4-390c-428f-b7f4-dd30368a8ae8', 'd60d3015-cc17-49ad-af6c-1ced3e5b68ed', 'ccc17475-b8e8-45fe-916c-643ca339a52f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:31 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:31 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:32 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.500s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:32 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Deleted volume successfully. Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c23dff40-1267-4ee5-a3c0-c0ddc6a9c35d tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-5a0ad4a9-a502-46c7-bf25-229f067313d3-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-2c5d88f1-237a-4264-85c5-8cc4e260e040-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-2c5d88f1-237a-4264-85c5-8cc4e260e040-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-quobyte-2c5d88f1-237a-4264-85c5-8cc4e260e040" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-2c5d88f1-237a-4264-85c5-8cc4e260e040" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be51b8b-9b85-4ae6-8288-bd47efa703a7]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:32 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 Apr 24 01:17:32 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:33 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040" returned: 0 in 0.548s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:33 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040 Apr 24 01:17:33 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:33 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-2c5d88f1-237a-4264-85c5-8cc4e260e040" returned: 0 in 0.497s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:33 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-2c5d88f1-237a-4264-85c5-8cc4e260e040" released by "delete_volume" :: held 1.085s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:33 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Created reservations ['79b3f0ef-cc47-4c7f-a24f-a68b10a1a0e6', 'b099a93e-fdbc-43b4-8f04-94a35237ba41', '9630df9b-c596-429b-a0a7-65c95a95a0ce', '2a899a48-3a3d-457d-8e7f-e3a0867b2584'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:34 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:34 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:34 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.451s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:34 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Deleted volume successfully. Apr 24 01:17:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-7b0e7b69-91ae-4efe-88cd-fa550f4f01fd tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-2c5d88f1-237a-4264-85c5-8cc4e260e040-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-e4ce47ff-3096-4fc5-a590-04a6e711ced1-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-e4ce47ff-3096-4fc5-a590-04a6e711ced1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-quobyte-e4ce47ff-3096-4fc5-a590-04a6e711ced1" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-e4ce47ff-3096-4fc5-a590-04a6e711ced1" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:35 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[785014f8-342f-49d2-9f10-e8d4f9d7a2da]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:35 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 Apr 24 01:17:35 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:35 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1" returned: 0 in 0.537s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:35 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1 Apr 24 01:17:35 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:36 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e4ce47ff-3096-4fc5-a590-04a6e711ced1" returned: 0 in 0.486s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-e4ce47ff-3096-4fc5-a590-04a6e711ced1" released by "delete_volume" :: held 1.063s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Created reservations ['d182b7ab-3105-458d-8949-00f33d8a3b56', '84c8cbef-e7d5-4ab9-a112-c835ad230b98', 'd441f97c-cdbb-4b21-ad8b-cfafed653cf4', '0671aa16-ac89-4c5b-a852-83a01029debf'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:36 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:36 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:36 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.450s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:36 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Deleted volume successfully. Apr 24 01:17:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-97c945f0-67f1-44f2-9d69-8f5167bc697f tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-e4ce47ff-3096-4fc5-a590-04a6e711ced1-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:37 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-25e3ee33-d302-4522-b91f-1fa0cd845095-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:37 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-25e3ee33-d302-4522-b91f-1fa0cd845095-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:37 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-quobyte-25e3ee33-d302-4522-b91f-1fa0cd845095" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:37 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-25e3ee33-d302-4522-b91f-1fa0cd845095" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:37 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42d398b-289a-49b0-a495-10d6c43c48fe]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:37 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 Apr 24 01:17:37 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:38 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095" returned: 0 in 0.627s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:38 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095 Apr 24 01:17:38 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:38 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-25e3ee33-d302-4522-b91f-1fa0cd845095" returned: 0 in 0.494s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-25e3ee33-d302-4522-b91f-1fa0cd845095" released by "delete_volume" :: held 1.167s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Created reservations ['7f47bb6e-cf1a-4948-b0e5-ceeccfc175bc', '61b852cf-c0ff-46b3-81c7-1af1975a6942', 'c24fd0a9-0a98-465f-a282-54a77ea2a304', '47403a02-0910-4382-a988-9f94da97a468'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:38 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:38 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:39 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.450s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:39 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Deleted volume successfully. Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8391beec-ade2-42d6-835f-a9ba342de04a tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-25e3ee33-d302-4522-b91f-1fa0cd845095-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-0c6ea15f-5157-449c-84fa-71e1c70a22e3-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-0c6ea15f-5157-449c-84fa-71e1c70a22e3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "cinder-quobyte-0c6ea15f-5157-449c-84fa-71e1c70a22e3" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-0c6ea15f-5157-449c-84fa-71e1c70a22e3" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ced2b8a-7675-46e2-a917-94083164a2cc]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:39 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 Apr 24 01:17:39 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:40 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3" returned: 0 in 0.535s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:40 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3 Apr 24 01:17:40 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:40 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c6ea15f-5157-449c-84fa-71e1c70a22e3" returned: 0 in 0.457s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-quobyte-0c6ea15f-5157-449c-84fa-71e1c70a22e3" released by "delete_volume" :: held 1.036s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Created reservations ['d79b8089-2eb1-49c9-b4ae-955966e3a6c1', '4fac985e-d5b2-466b-b2b9-a6fb3aaa3071', '38a05089-ccff-477b-9836-f0217aa67427', '37555bad-e12a-4576-80cd-67af37b61b97'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:40 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:40 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:41 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.469s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:41 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:41 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Deleted volume successfully. Apr 24 01:17:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a5948024-9432-46fc-a8ad-fbe4f063efe9 tempest-CreateVolumesFromImageTest-1960286033 None] Lock "cinder-0c6ea15f-5157-449c-84fa-71e1c70a22e3-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (e6ef85c0-85f3-44ea-aa43-6e29a222c608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545d17ab-bb96-4a97-b0aa-802387940b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545d17ab-bb96-4a97-b0aa-802387940b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2134772868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f1d8ad-0503-42c5-89ff-fabb0843ce37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:44Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62a4089-4ac5-4d63-8e3b-26696989cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62a4089-4ac5-4d63-8e3b-26696989cb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d890d96a-2f35-4fa0-be0e-8c8172e4ed96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d890d96a-2f35-4fa0-be0e-8c8172e4ed96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f1d8ad-0503-42c5-89ff-fabb0843ce37', 'volume_name': 'volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c909cd-020b-4303-bdd7-2c9a6adf2b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c909cd-020b-4303-bdd7-2c9a6adf2b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5b08ce-bfa1-416e-9199-7e43b2407a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:44 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume 51f1d8ad-0503-42c5-89ff-fabb0843ce37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37', 'volume_size': 1} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2134772868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f1d8ad-0503-42c5-89ff-fabb0843ce37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:44Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Creating volume 51f1d8ad-0503-42c5-89ff-fabb0843ce37 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:44 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:44 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 1073741824 Apr 24 01:17:44 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:45 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 1073741824" returned: 0 in 0.882s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:45 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 Apr 24 01:17:45 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:45 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37" returned: 0 in 0.426s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5b08ce-bfa1-416e-9199-7e43b2407a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537e5438-426f-4dbc-aa86-5bbe77b6cd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:45 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 (51f1d8ad-0503-42c5-89ff-fabb0843ce37): created successfully Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537e5438-426f-4dbc-aa86-5bbe77b6cd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:45 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (e6ef85c0-85f3-44ea-aa43-6e29a222c608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:45 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-8689acb3-f240-4f6a-a351-514635582a8d tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created volume successfully. Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (ed02e015-6f70-4446-93ce-e3b3c81aa4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32f8d9f-c2dd-4fec-81e6-ef21ec101c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32f8d9f-c2dd-4fec-81e6-ef21ec101c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827703306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff62e33b-7097-41ef-8b8d-27d23497924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:47Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52104d8c-e764-4b44-8e6c-c9f7b0d77f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52104d8c-e764-4b44-8e6c-c9f7b0d77f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1e9e77-d8bd-42bb-a382-fcf76e672619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1e9e77-d8bd-42bb-a382-fcf76e672619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff62e33b-7097-41ef-8b8d-27d23497924a', 'volume_name': 'volume-ff62e33b-7097-41ef-8b8d-27d23497924a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b86677-2179-484c-868d-66e907ccc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b86677-2179-484c-868d-66e907ccc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b420df2-8048-4fee-9d59-ea29a50af7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:46 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume ff62e33b-7097-41ef-8b8d-27d23497924a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff62e33b-7097-41ef-8b8d-27d23497924a', 'volume_size': 1} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827703306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff62e33b-7097-41ef-8b8d-27d23497924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:47Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Creating volume ff62e33b-7097-41ef-8b8d-27d23497924a {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:46 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:46 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a 1073741824 Apr 24 01:17:46 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (796ed007-b950-4d59-a50a-5d2a7390b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4216653-7a0d-493c-9c6d-cab6077dcd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4216653-7a0d-493c-9c6d-cab6077dcd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340835461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa45a269-6356-4e7a-bb35-829e9b796213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:47Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c545a266-9500-4a85-bace-c30919648c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c545a266-9500-4a85-bace-c30919648c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeb60f2-a710-4827-8168-c8491f0af1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeb60f2-a710-4827-8168-c8491f0af1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa45a269-6356-4e7a-bb35-829e9b796213', 'volume_name': 'volume-fa45a269-6356-4e7a-bb35-829e9b796213', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d9814f-cd50-48a6-b187-fea9fd78d909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d9814f-cd50-48a6-b187-fea9fd78d909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f53584-2ff1-4b26-97db-c9b99401a50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume fa45a269-6356-4e7a-bb35-829e9b796213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa45a269-6356-4e7a-bb35-829e9b796213', 'volume_size': 1} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-782704de-e5ba-4509-8873-0abe896ce3f6 tempest-VolumesActionsTest-445014549 None] Acquiring lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" by "attach_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-782704de-e5ba-4509-8873-0abe896ce3f6 tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" acquired by "attach_volume" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (af83749a-a1d6-46d8-804a-b180c1d2f6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f312b726-5992-4822-9799-538fefd4632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f312b726-5992-4822-9799-538fefd4632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345574493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6700415-d83e-4990-ba14-339e6a777eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:48Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6b4f97-1dd3-4d38-914f-075121c254f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6b4f97-1dd3-4d38-914f-075121c254f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5aae3a6-76a1-47fe-b505-c438e156f41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5aae3a6-76a1-47fe-b505-c438e156f41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6700415-d83e-4990-ba14-339e6a777eaa', 'volume_name': 'volume-c6700415-d83e-4990-ba14-339e6a777eaa', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9b1fb6-7ee0-4eb7-ad9d-4a3ab5bd89fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9b1fb6-7ee0-4eb7-ad9d-4a3ab5bd89fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f864bc1-daac-4d42-aa55-a239f9df7b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:47 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume c6700415-d83e-4990-ba14-339e6a777eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6700415-d83e-4990-ba14-339e6a777eaa', 'volume_size': 1} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a 1073741824" returned: 0 in 0.873s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-782704de-e5ba-4509-8873-0abe896ce3f6 tempest-VolumesActionsTest-445014549 None] Attaching volume c5e8b8e4-ad6c-4548-8804-ba1287cb2ece to instance c1d20a41-817b-41a9-8cb5-dd3de1c8f34a at mountpoint /dev/vdb on host None. Apr 24 01:17:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-782704de-e5ba-4509-8873-0abe896ce3f6 tempest-VolumesActionsTest-445014549 None] Attach volume completed successfully. Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-782704de-e5ba-4509-8873-0abe896ce3f6 tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" released by "attach_volume" :: held 0.222s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:47 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a Apr 24 01:17:47 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (4e5b5456-43c3-46a4-9585-dde88f0ea100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f737c3-f5c8-4226-b2de-62ff9b881c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f737c3-f5c8-4226-b2de-62ff9b881c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1661818873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810a1747-e983-44e5-91b6-776d35c2ba00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:48Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e590c24a-7c70-49c0-aa55-49daada4f767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e590c24a-7c70-49c0-aa55-49daada4f767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cddd58-e260-4d70-b260-b16aeb2b9420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cddd58-e260-4d70-b260-b16aeb2b9420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '810a1747-e983-44e5-91b6-776d35c2ba00', 'volume_name': 'volume-810a1747-e983-44e5-91b6-776d35c2ba00', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76f7284-a562-4454-a24e-dbd095898a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76f7284-a562-4454-a24e-dbd095898a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3949c2ee-39c4-4514-ac64-d21fe8b55a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume 810a1747-e983-44e5-91b6-776d35c2ba00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-810a1747-e983-44e5-91b6-776d35c2ba00', 'volume_size': 1} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37b8f594-0805-4c4f-b783-058a30cd3dbe tempest-VolumesActionsTest-445014549 None] Acquiring lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-detach_volume" by "detach_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:48 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a" returned: 0 in 0.639s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37b8f594-0805-4c4f-b783-058a30cd3dbe tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-37b8f594-0805-4c4f-b783-058a30cd3dbe tempest-VolumesActionsTest-445014549 None] Detaching volume c5e8b8e4-ad6c-4548-8804-ba1287cb2ece from instance c1d20a41-817b-41a9-8cb5-dd3de1c8f34a. Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340835461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa45a269-6356-4e7a-bb35-829e9b796213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:47Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Creating volume fa45a269-6356-4e7a-bb35-829e9b796213 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:48 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b420df2-8048-4fee-9d59-ea29a50af7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff62e33b-7097-41ef-8b8d-27d23497924a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2904b5eb-f45d-4ebd-89f2-3f8f2af78f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 1073741824 Apr 24 01:17:48 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:48 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume volume-ff62e33b-7097-41ef-8b8d-27d23497924a (ff62e33b-7097-41ef-8b8d-27d23497924a): created successfully Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2904b5eb-f45d-4ebd-89f2-3f8f2af78f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (ed02e015-6f70-4446-93ce-e3b3c81aa4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c35bf7c9-ef10-4210-b2d1-73280f594849 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created volume successfully. Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (ac087387-1f9a-497f-a720-3ddd69ba252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5651a5a9-a0a9-4939-9341-e554796a7ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5651a5a9-a0a9-4939-9341-e554796a7ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-745041669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f560138a-5c0b-426b-b141-2f830138ee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:48Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacd1ba7-306a-426d-9d9e-3a93c08ba48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacd1ba7-306a-426d-9d9e-3a93c08ba48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19b2370-fd27-4aa7-a29e-a793779c7a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19b2370-fd27-4aa7-a29e-a793779c7a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f560138a-5c0b-426b-b141-2f830138ee03', 'volume_name': 'volume-f560138a-5c0b-426b-b141-2f830138ee03', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab2406a-5ff7-4dcf-832f-63bf03ceb81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab2406a-5ff7-4dcf-832f-63bf03ceb81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fd1a7e-70a4-47af-9793-9cd6841b182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:48 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume f560138a-5c0b-426b-b141-2f830138ee03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f560138a-5c0b-426b-b141-2f830138ee03', 'volume_size': 1} Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-37b8f594-0805-4c4f-b783-058a30cd3dbe tempest-VolumesActionsTest-445014549 None] Detach volume completed successfully. Apr 24 01:17:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-37b8f594-0805-4c4f-b783-058a30cd3dbe tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-detach_volume" released by "detach_volume" :: held 0.204s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:49 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 1073741824" returned: 0 in 0.770s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:49 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 Apr 24 01:17:49 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:49 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.092s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345574493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6700415-d83e-4990-ba14-339e6a777eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:48Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Creating volume c6700415-d83e-4990-ba14-339e6a777eaa {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:49 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:49 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa 1073741824 Apr 24 01:17:49 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f53584-2ff1-4b26-97db-c9b99401a50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa45a269-6356-4e7a-bb35-829e9b796213', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4ad9a5-a656-439e-9bf4-503ac0b864ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:49 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume volume-fa45a269-6356-4e7a-bb35-829e9b796213 (fa45a269-6356-4e7a-bb35-829e9b796213): created successfully Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4ad9a5-a656-439e-9bf4-503ac0b864ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (796ed007-b950-4d59-a50a-5d2a7390b7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:49 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-79982f9d-21f2-4a80-a30d-0a3b0a818c31 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created volume successfully. Apr 24 01:17:50 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa 1073741824" returned: 0 in 0.778s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:50 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa Apr 24 01:17:50 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:51 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa" returned: 0 in 0.568s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.090s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1661818873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810a1747-e983-44e5-91b6-776d35c2ba00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:48Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Creating volume 810a1747-e983-44e5-91b6-776d35c2ba00 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:51 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f864bc1-daac-4d42-aa55-a239f9df7b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6700415-d83e-4990-ba14-339e6a777eaa', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:51 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 1073741824 Apr 24 01:17:51 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfdb566-656e-49da-860f-3de09ed38f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:51 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume volume-c6700415-d83e-4990-ba14-339e6a777eaa (c6700415-d83e-4990-ba14-339e6a777eaa): created successfully Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfdb566-656e-49da-860f-3de09ed38f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (af83749a-a1d6-46d8-804a-b180c1d2f6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:51 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e477be2e-2a53-4034-bc53-1659d47f13c7 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created volume successfully. Apr 24 01:17:51 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 1073741824" returned: 0 in 0.660s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:51 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 Apr 24 01:17:51 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:52 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00" returned: 0 in 0.494s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.761s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-745041669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f560138a-5c0b-426b-b141-2f830138ee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2014d86cfc4313829954291996cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:17:48Z,use_quota=True,user_id='2014fa168bd44451bea1a54891184741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Creating volume f560138a-5c0b-426b-b141-2f830138ee03 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:17:52 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3949c2ee-39c4-4514-ac64-d21fe8b55a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810a1747-e983-44e5-91b6-776d35c2ba00', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab653673-0331-4904-be91-63f55b657aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:52 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 1073741824 Apr 24 01:17:52 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:52 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume volume-810a1747-e983-44e5-91b6-776d35c2ba00 (810a1747-e983-44e5-91b6-776d35c2ba00): created successfully Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab653673-0331-4904-be91-63f55b657aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (4e5b5456-43c3-46a4-9585-dde88f0ea100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:52 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1bdfc13a-7c77-488b-b45e-91c07acc454e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created volume successfully. Apr 24 01:17:52 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 1073741824" returned: 0 in 0.626s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:53 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 Apr 24 01:17:53 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:53 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03" returned: 0 in 0.449s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:17:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fd1a7e-70a4-47af-9793-9cd6841b182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f560138a-5c0b-426b-b141-2f830138ee03', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bdde64-7eaa-48fb-9101-c6ece02ae0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:17:53 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Volume volume-f560138a-5c0b-426b-b141-2f830138ee03 (f560138a-5c0b-426b-b141-2f830138ee03): created successfully Apr 24 01:17:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bdde64-7eaa-48fb-9101-c6ece02ae0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:17:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Flow 'volume_create_manager' (ac087387-1f9a-497f-a720-3ddd69ba252e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:17:53 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-879de584-1a93-4370-822e-153c19f4ad3c tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created volume successfully. Apr 24 01:17:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-f560138a-5c0b-426b-b141-2f830138ee03-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-f560138a-5c0b-426b-b141-2f830138ee03-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-quobyte-f560138a-5c0b-426b-b141-2f830138ee03" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-f560138a-5c0b-426b-b141-2f830138ee03" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:54 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cee268-2f16-4298-88dc-7af456048590]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:54 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 Apr 24 01:17:54 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:54 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03" returned: 0 in 0.550s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:54 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03 Apr 24 01:17:54 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:55 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f560138a-5c0b-426b-b141-2f830138ee03" returned: 0 in 0.464s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-f560138a-5c0b-426b-b141-2f830138ee03" released by "delete_volume" :: held 1.055s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created reservations ['2b25a99c-87a9-4d48-a200-388bd33538ca', 'b4f0f8bc-a3a6-44d8-ada6-8bb5477b1f56', '55875517-c594-43ec-988a-bac8f31312af', '65f4f91f-c5fd-4dd2-a359-3b21d339ded0'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:55 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:55 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:55 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.546s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Deleted volume successfully. Apr 24 01:17:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-784382db-52c6-4fc1-8f1f-514c9d354305 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-f560138a-5c0b-426b-b141-2f830138ee03-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:56 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-810a1747-e983-44e5-91b6-776d35c2ba00-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:56 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-810a1747-e983-44e5-91b6-776d35c2ba00-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:56 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-quobyte-810a1747-e983-44e5-91b6-776d35c2ba00" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:56 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-810a1747-e983-44e5-91b6-776d35c2ba00" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:56 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[44390d62-5370-48c0-9562-192666de29d1]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:56 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 Apr 24 01:17:56 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:56 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00" returned: 0 in 0.544s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:56 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00 Apr 24 01:17:56 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e84d0b-7285-45e2-9864-970d94bc4769]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:57 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:17:57 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:57 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-810a1747-e983-44e5-91b6-776d35c2ba00" returned: 0 in 0.474s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-810a1747-e983-44e5-91b6-776d35c2ba00" released by "delete_volume" :: held 1.071s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created reservations ['2d7c12fe-1189-48b3-b71d-565cb36cbbce', '6e3a5d25-0532-4ddd-b9b2-807d01690e68', 'f884c7d8-deb3-4cdc-b7ce-f47dbc331566', '36c6e719-ff60-47be-b00b-4389e59fab16'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:57 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:17:57 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:57 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.543s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a1d10e-68a7-423d-b887-98f4780b2781]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:57 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:17:57 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:58 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.453s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:17:58 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Deleted volume successfully. Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a6bffa87-0403-40dd-9bf7-cdc03684d51e tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-810a1747-e983-44e5-91b6-776d35c2ba00-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:17:58 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.512s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.6036a6ea-e6c0-4d6d-b1a6-641f022f514ecton5mrk.img {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:58 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.6036a6ea-e6c0-4d6d-b1a6-641f022f514ecton5mrk.img Apr 24 01:17:58 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-c6700415-d83e-4990-ba14-339e6a777eaa-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-c6700415-d83e-4990-ba14-339e6a777eaa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-quobyte-c6700415-d83e-4990-ba14-339e6a777eaa" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-c6700415-d83e-4990-ba14-339e6a777eaa" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c14891e-d43b-477e-b3d4-d2267db49b3c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:17:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:17:58 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa Apr 24 01:17:58 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:00 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa" returned: 0 in 1.685s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:00 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa Apr 24 01:18:00 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:01 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c6700415-d83e-4990-ba14-339e6a777eaa" returned: 0 in 0.926s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-c6700415-d83e-4990-ba14-339e6a777eaa" released by "delete_volume" :: held 2.669s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created reservations ['2fa93b0c-2fad-45d4-a85c-8de582b46029', '147501c5-6252-4c34-b24a-d2eae9f8f50a', '387a87d4-e03d-48c9-9201-25c4b8b16f04', '9122c529-13ed-4f01-ac76-2bb896eb01d8'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:01 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:18:01 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-fa45a269-6356-4e7a-bb35-829e9b796213-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-fa45a269-6356-4e7a-bb35-829e9b796213-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-quobyte-fa45a269-6356-4e7a-bb35-829e9b796213" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-fa45a269-6356-4e7a-bb35-829e9b796213" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8514a957-9e1a-4826-aa2b-8d028ee75682]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:02 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 Apr 24 01:18:02 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:02 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.6036a6ea-e6c0-4d6d-b1a6-641f022f514ecton5mrk.img" returned: 0 in 4.688s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5e71ae-ea68-42ed-b4b4-dd99e702b0b3]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:02 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.312s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:18:02 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Deleted volume successfully. Apr 24 01:18:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1373506a-b37a-44ef-8be2-49daad5fac79 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-c6700415-d83e-4990-ba14-339e6a777eaa-delete_volume" released by "delete_volume" :: held 4.389s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:03 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:18:03 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:03 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213" returned: 0 in 0.918s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:03 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213 Apr 24 01:18:03 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:03 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-fa45a269-6356-4e7a-bb35-829e9b796213" returned: 0 in 0.458s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-fa45a269-6356-4e7a-bb35-829e9b796213" released by "delete_volume" :: held 1.450s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created reservations ['14b380d0-1293-471a-8dd6-dd174d385e32', '104fffb3-d9b0-439b-8a70-c9227b5f5703', 'bf680820-58d7-4332-8bfc-25ffff419419', 'd34b25fb-dea7-4bba-88ec-d80196dd3885'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:18:03 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.672s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.6036a6ea-e6c0-4d6d-b1a6-641f022f514ecton5mrk.img {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:18:03 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Converted 1024.00 MB image at 218.34 MB/s Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] 6036a6ea-e6c0-4d6d-b1a6-641f022f514e was raw, no need to convert to raw {{(pid=81925) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:03 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:18:03 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:04 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.449s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:18:04 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Deleted volume successfully. Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d7e43ec5-0491-4393-bc3d-2637acb81fcb tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-fa45a269-6356-4e7a-bb35-829e9b796213-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-ff62e33b-7097-41ef-8b8d-27d23497924a-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-ff62e33b-7097-41ef-8b8d-27d23497924a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-quobyte-ff62e33b-7097-41ef-8b8d-27d23497924a" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-ff62e33b-7097-41ef-8b8d-27d23497924a" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d759c82b-4a74-42a2-9000-68b74fca7d77]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:04 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a Apr 24 01:18:04 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:04 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a" returned: 0 in 0.589s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:04 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a Apr 24 01:18:04 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:05 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ff62e33b-7097-41ef-8b8d-27d23497924a" returned: 0 in 0.477s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-ff62e33b-7097-41ef-8b8d-27d23497924a" released by "delete_volume" :: held 1.120s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created reservations ['76f11b04-5a9e-4d22-8834-aa21db15f603', '44afa45b-40dd-4fd2-8e9d-8dae6d571f70', '468ef1a9-3c13-4462-83b4-6b4caf3aadb8', '6ca7109d-1365-4931-924d-f6b1e55ab514'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:05 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:18:05 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:06 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.457s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:18:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Deleted volume successfully. Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3f4cd740-c7d0-482f-8c9b-c272a97def44 tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-ff62e33b-7097-41ef-8b8d-27d23497924a-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-51f1d8ad-0503-42c5-89ff-fabb0843ce37-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-51f1d8ad-0503-42c5-89ff-fabb0843ce37-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "cinder-quobyte-51f1d8ad-0503-42c5-89ff-fabb0843ce37" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-51f1d8ad-0503-42c5-89ff-fabb0843ce37" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[31171dbe-5761-4511-a8b5-5a601d13ce7c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:06 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 Apr 24 01:18:06 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:07 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37" returned: 0 in 0.597s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:07 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37 Apr 24 01:18:07 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:07 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-51f1d8ad-0503-42c5-89ff-fabb0843ce37" returned: 0 in 0.448s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-quobyte-51f1d8ad-0503-42c5-89ff-fabb0843ce37" released by "delete_volume" :: held 1.128s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Created reservations ['5430c631-e785-457f-9efd-8f8357b55ae3', 'fa3b15a9-b585-4f4d-a8cc-4d8f15c263ca', '6606c927-23a9-4628-85ca-36f864f582b4', 'c773eaf4-c432-4fa8-af22-45691d404b39'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:07 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:18:07 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:08 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.465s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:08 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:18:08 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Deleted volume successfully. Apr 24 01:18:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-8382be56-1545-4fbf-aa9f-602fa5b0333a tempest-CreateVolumesFromSourceVolumeTest-1420775271 None] Lock "cinder-51f1d8ad-0503-42c5-89ff-fabb0843ce37-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:18:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:11 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:18:11 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:12 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.469s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:18:17 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=108,cinder:UPDATE=124,cinder:INSERT=31,cinder:DELETE=9 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:18:18 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=74,cinder:UPDATE=130,cinder:INSERT=27,cinder:DELETE=13 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:18:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 21.979s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:19 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Uploaded volume to glance image-id: 6036a6ea-e6c0-4d6d-b1a6-641f022f514e. {{(pid=81925) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 01:18:19 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-114aaa87-b45d-4261-9ae2-4504e42a2890 tempest-VolumesActionsTest-445014549 None] Copy volume to image completed successfully. Apr 24 01:18:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:20 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ca21c0-3f65-435b-89a3-cc23f977a121]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:20 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:18:20 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:21 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.562s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:21 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea43549-4eaa-4d51-8525-60304a599ae7]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:21 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:18:21 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:21 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.519s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:21 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img Apr 24 01:18:21 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:26 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img" returned: 0 in 4.165s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:26 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[82735ae7-7a4d-44e6-b7b0-5c27dcb95808]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:26 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:18:26 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:26 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.611s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:26 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece, size 1024.00 MB, duration 4.17 sec, destination /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:18:26 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Converted 1024.00 MB image at 245.79 MB/s Apr 24 01:18:26 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] 9ed05263-f530-4083-9bf4-4711b8616bc8 was raw, converting to qcow2 {{(pid=81925) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 24 01:18:26 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4303fd0e-520b-4b09-83b0-15d6cae26528]: (4, 'raw') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:26 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img Apr 24 01:18:26 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:27 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img" returned: 0 in 0.466s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:27 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img Apr 24 01:18:27 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:27 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img" returned: 1 in 0.473s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img' failed. Not Retrying. {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 01:18:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img /opt/stack/data/cinder/conversion/vol_upload_brmr0p0p {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:27 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img /opt/stack/data/cinder/conversion/vol_upload_brmr0p0p Apr 24 01:18:27 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:28 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img /opt/stack/data/cinder/conversion/vol_upload_brmr0p0p" returned: 0 in 0.421s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:28 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Image conversion details: src /opt/stack/data/cinder/conversion/c5e8b8e4-ad6c-4548-8804-ba1287cb2ece.temp_image.9ed05263-f530-4083-9bf4-4711b8616bc8jhap_wcc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_brmr0p0p {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:18:28 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 24 01:18:28 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea158f0-af4a-4fce-9522-7f935beb80aa]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_brmr0p0p {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:28 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_brmr0p0p Apr 24 01:18:28 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:28 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_brmr0p0p" returned: 0 in 0.463s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.934s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:29 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Uploaded volume to glance image-id: 9ed05263-f530-4083-9bf4-4711b8616bc8. {{(pid=81925) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 01:18:29 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0eedd7ab-df54-4276-a19a-0e1da3048b1c tempest-VolumesActionsTest-445014549 None] Copy volume to image completed successfully. Apr 24 01:18:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Acquiring lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Acquiring lock "cinder-quobyte-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Lock "cinder-quobyte-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:30 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1958df-0542-4d0d-a8cc-fba2aa6deb19]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:31 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:18:31 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:31 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.530s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:31 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece Apr 24 01:18:31 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:31 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" returned: 0 in 0.460s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:31 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Lock "cinder-quobyte-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece" released by "delete_volume" :: held 1.027s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Created reservations ['49294e0c-c058-42ff-b5b4-8c718f708440', '7aac70d3-dd75-4e6b-9396-0710eb46b911', 'ba2e0527-8a8b-44fd-b489-ac4ae87ab267', '53f989fd-6fef-4578-ad8d-8c4fb4a81ade'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:32 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:18:32 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:32 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.407s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:18:32 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Deleted volume successfully. Apr 24 01:18:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ccdd9c2e-4432-46ed-8e2c-401a640f6e3d tempest-VolumesActionsTest-445014549 None] Lock "cinder-c5e8b8e4-ad6c-4548-8804-ba1287cb2ece-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Flow 'volume_create_manager' (c87bc08e-79cf-4b7d-b3c8-e4b6b5eb4a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdbd97a-801e-4986-b79c-50dd11b5d257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdbd97a-801e-4986-b79c-50dd11b5d257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1161265911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9f86e0-87be-4a7a-8132-8ec12023c18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8015e31ab154cf6aae71f0c3a524411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:40Z,use_quota=True,user_id='ba40feda845d4c0c89a276e22dff2233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadae97c-fcc9-41a3-955b-df39ce30133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadae97c-fcc9-41a3-955b-df39ce30133c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec3040f-dff7-420d-ab87-93b86602e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec3040f-dff7-420d-ab87-93b86602e55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9f86e0-87be-4a7a-8132-8ec12023c18d', 'volume_name': 'volume-af9f86e0-87be-4a7a-8132-8ec12023c18d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dfacb1-881a-41c1-bbef-1b5528a6d7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dfacb1-881a-41c1-bbef-1b5528a6d7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28bc1c1-1db1-46da-a0c4-e27a3b54e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:40 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Volume af9f86e0-87be-4a7a-8132-8ec12023c18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9f86e0-87be-4a7a-8132-8ec12023c18d', 'volume_size': 1} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1161265911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9f86e0-87be-4a7a-8132-8ec12023c18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8015e31ab154cf6aae71f0c3a524411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:40Z,use_quota=True,user_id='ba40feda845d4c0c89a276e22dff2233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Creating volume af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:18:40 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:40 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d 1073741824 Apr 24 01:18:40 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:40 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d 1073741824" returned: 0 in 0.583s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:40 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d Apr 24 01:18:40 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:41 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d" returned: 0 in 0.430s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:18:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28bc1c1-1db1-46da-a0c4-e27a3b54e30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9f86e0-87be-4a7a-8132-8ec12023c18d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d206a79-8a84-4b37-be70-75b23f9d8254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:41 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Volume volume-af9f86e0-87be-4a7a-8132-8ec12023c18d (af9f86e0-87be-4a7a-8132-8ec12023c18d): created successfully Apr 24 01:18:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d206a79-8a84-4b37-be70-75b23f9d8254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Flow 'volume_create_manager' (c87bc08e-79cf-4b7d-b3c8-e4b6b5eb4a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:18:41 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2b4c2ade-9265-4fb2-a0d7-88fc33e46aba tempest-VolumesCloneTest-1898315996 None] Created volume successfully. Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Flow 'volume_create_manager' (78177c86-f607-4fae-b0c4-3a3d579bce6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d7be1e-be04-446a-bb22-e2defd025ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d7be1e-be04-446a-bb22-e2defd025ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-360404146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8015e31ab154cf6aae71f0c3a524411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=af9f86e0-87be-4a7a-8132-8ec12023c18d,status='creating',terminated_at=None,updated_at=2026-04-23T23:18:43Z,use_quota=True,user_id='ba40feda845d4c0c89a276e22dff2233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603bbfe2-be21-4e7f-ab9b-9eaf1ba6602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603bbfe2-be21-4e7f-ab9b-9eaf1ba6602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a863ed20-65c4-45b5-8f1c-51f66cee841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a863ed20-65c4-45b5-8f1c-51f66cee841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2', 'volume_name': 'volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2', 'volume_size': 2, 'source_volid': 'af9f86e0-87be-4a7a-8132-8ec12023c18d', 'source_volstatus': 'available'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed089da-9f61-48e3-9674-9edb517a99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed089da-9f61-48e3-9674-9edb517a99b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf6f417-e6d3-4778-a00d-06a05340ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:42 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Volume 8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2', 'volume_size': 2, 'source_volid': 'af9f86e0-87be-4a7a-8132-8ec12023c18d', 'source_volstatus': 'available'} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:42 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Cloning volume af9f86e0-87be-4a7a-8132-8ec12023c18d to volume 8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Creating offline snapshot 86eeff17-41b6-4e88-937a-d8f120e2c1ab of volume af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb8f8f-5c9b-4a2f-827d-ae840e8dcd1d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:42 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d Apr 24 01:18:42 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:43 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d" returned: 0 in 0.517s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:43 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab 1G Apr 24 01:18:43 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:43 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab 1G" returned: 0 in 0.593s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9f86e0-87be-4a7a-8132-8ec12023c18d -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:43 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9f86e0-87be-4a7a-8132-8ec12023c18d -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab Apr 24 01:18:43 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:44 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9f86e0-87be-4a7a-8132-8ec12023c18d -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab" returned: 0 in 0.472s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:44 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab is being set with open permissions: ugo+rw Apr 24 01:18:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:44 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab Apr 24 01:18:44 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:44 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab" returned: 0 in 0.439s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:44 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.info Apr 24 01:18:44 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:45 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.info" returned: 0 in 0.447s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:45 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.info is being set with open permissions: ugo+rw Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:45 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.info Apr 24 01:18:45 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:45 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.info" returned: 0 in 0.431s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "cinder-quobyte-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-quobyte-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] snapshot: 86eeff17-41b6-4e88-937a-d8f120e2c1ab, volume: 8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5979e62-b3f3-44b2-abe3-b7401f13792c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:45 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab Apr 24 01:18:45 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:46 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab" returned: 0 in 0.505s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af9f86e0-87be-4a7a-8132-8ec12023c18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dbb434-70a0-40c9-a15b-363d9742ce47]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:46 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d Apr 24 01:18:46 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:46 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d" returned: 0 in 0.510s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:18:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:46 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 Apr 24 01:18:46 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:51 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" returned: 0 in 4.651s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4aa795-6b00-4f70-b6f1-a00f9ccdd12d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:51 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d Apr 24 01:18:51 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:52 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d" returned: 0 in 0.659s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:18:52 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Converted 1024.00 MB image at 220.11 MB/s Apr 24 01:18:52 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 is being set with open permissions: ugo+rw Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:52 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 Apr 24 01:18:52 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:52 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" returned: 0 in 0.460s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-quobyte-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" released by "_copy_volume_from_snapshot" :: held 6.870s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "cinder-quobyte-86eeff17-41b6-4e88-937a-d8f120e2c1ab" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-quobyte-86eeff17-41b6-4e88-937a-d8f120e2c1ab" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Deleting offline snapshot 86eeff17-41b6-4e88-937a-d8f120e2c1ab of volume af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] snapshot_file for this snap is: volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba74a9-415c-4339-888a-66756130ae6c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:52 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab Apr 24 01:18:52 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:53 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab" returned: 0 in 0.516s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af9f86e0-87be-4a7a-8132-8ec12023c18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:18:53 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a8746d-2f78-446e-a7a6-07135b8ef643]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:53 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d Apr 24 01:18:53 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:53 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d" returned: 0 in 0.513s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:53 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab Apr 24 01:18:53 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:54 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab" returned: 0 in 0.547s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:54 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab Apr 24 01:18:54 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:54 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d.86eeff17-41b6-4e88-937a-d8f120e2c1ab" returned: 0 in 0.464s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-quobyte-86eeff17-41b6-4e88-937a-d8f120e2c1ab" released by "_delete_snapshot" :: held 2.126s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.082s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf6f417-e6d3-4778-a00d-06a05340ad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2', 'volume_size': 2, 'source_volid': 'af9f86e0-87be-4a7a-8132-8ec12023c18d', 'source_volstatus': 'available'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6030e6e0-b15f-4023-a69f-76f03732ef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:18:54 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Volume volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 (8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2): created successfully Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6030e6e0-b15f-4023-a69f-76f03732ef73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:18:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Flow 'volume_create_manager' (78177c86-f607-4fae-b0c4-3a3d579bce6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:18:54 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-488a9545-ecc2-494e-98fa-d5a5fdfe44b2 tempest-VolumesCloneTest-1898315996 None] Created volume successfully. Apr 24 01:18:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "cinder-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "cinder-quobyte-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-quobyte-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:55 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[738f0841-2dba-43d0-bc91-efb18ee12d6e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:55 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 Apr 24 01:18:55 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:56 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" returned: 0 in 0.504s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:56 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2 Apr 24 01:18:56 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:56 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" returned: 0 in 0.425s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-quobyte-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2" released by "delete_volume" :: held 0.970s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Created reservations ['cd75e763-5e04-4cc5-a4a7-8b21950d8fee', '6957ee35-d7c4-469b-a392-100dc66de13e', '3bbf1b64-2eb1-4b5e-8684-34ed9b407766', 'e9c5dd44-7cb3-4587-a040-a59a20320f1f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:56 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:18:56 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:57 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.465s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:57 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:18:57 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Deleted volume successfully. Apr 24 01:18:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-c9583479-8df2-4ce9-aa86-646941ccd494 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-8c8dc0f4-a5f3-40a9-9f13-7f27161a6cb2-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "cinder-af9f86e0-87be-4a7a-8132-8ec12023c18d-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-af9f86e0-87be-4a7a-8132-8ec12023c18d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "cinder-quobyte-af9f86e0-87be-4a7a-8132-8ec12023c18d" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:18:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-quobyte-af9f86e0-87be-4a7a-8132-8ec12023c18d" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:18:58 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c207c-1e8a-4308-9ea0-d92c609c3263]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:18:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:58 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d Apr 24 01:18:58 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:58 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d" returned: 0 in 0.530s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:58 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d Apr 24 01:18:58 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:59 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af9f86e0-87be-4a7a-8132-8ec12023c18d" returned: 0 in 0.449s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-quobyte-af9f86e0-87be-4a7a-8132-8ec12023c18d" released by "delete_volume" :: held 1.046s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Created reservations ['a789be18-fd8d-41bf-ba52-a752890de33d', '46c85434-4711-4c41-b3c4-d4381a84044a', '9f42f0b9-db48-4e55-8f4d-28cac72a56c3', '4eaeb451-2a4a-4e16-b3fe-fafc473a1816'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:18:59 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:18:59 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:18:59 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.420s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:18:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Deleted volume successfully. Apr 24 01:18:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac96e969-470e-4752-be55-2d2ac68b16f0 tempest-VolumesCloneTest-1898315996 None] Lock "cinder-af9f86e0-87be-4a7a-8132-8ec12023c18d-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Flow 'volume_create_manager' (018ef643-0a82-4c93-b196-d40b50305ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa28c0ac-44b7-4bae-b754-2d32b0bf4bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa28c0ac-44b7-4bae-b754-2d32b0bf4bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1019381586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236fb1f26d584f9490069d8293792d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:03Z,use_quota=True,user_id='f7588d931d1947d69c2f8fa40d5b4f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666b3a28-3728-4c89-9695-0ef5186d646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666b3a28-3728-4c89-9695-0ef5186d646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02bb6f8-1973-4aaf-a27f-ff37c527ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02bb6f8-1973-4aaf-a27f-ff37c527ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76', 'volume_name': 'volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60d8d48-bda8-43d6-a8e8-48f33a23d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60d8d48-bda8-43d6-a8e8-48f33a23d33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d82f0fd-b6fc-4d18-858c-127b506692ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:02 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Volume 92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76', 'volume_size': 1} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1019381586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236fb1f26d584f9490069d8293792d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:03Z,use_quota=True,user_id='f7588d931d1947d69c2f8fa40d5b4f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Creating volume 92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:19:02 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:19:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:02 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 1073741824 Apr 24 01:19:02 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:03 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 1073741824" returned: 0 in 0.662s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:03 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 Apr 24 01:19:03 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:03 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76" returned: 0 in 0.411s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d82f0fd-b6fc-4d18-858c-127b506692ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fb67db-1042-4352-bf22-7015f591a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:03 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Volume volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 (92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76): created successfully Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fb67db-1042-4352-bf22-7015f591a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:03 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Flow 'volume_create_manager' (018ef643-0a82-4c93-b196-d40b50305ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:19:03 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0d29c847-48c8-47bb-8144-b6ce4a94ce15 tempest-VolumesNegativeTest-1723593206 None] Created volume successfully. Apr 24 01:19:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:19:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:19:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:19:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:11 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:19:11 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:12 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.491s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:19:13 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=25,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=2 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:19:13 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=42,cinder:SELECT=29,cinder:INSERT=9,cinder:DELETE=4 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:19:33 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Acquiring lock "cinder-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:19:33 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Lock "cinder-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:19:33 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Acquiring lock "cinder-quobyte-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:19:33 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Lock "cinder-quobyte-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:19:33 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[869122ba-93b1-42b5-b1dc-5bb9d0befbdc]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:19:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:33 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 Apr 24 01:19:33 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:34 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76" returned: 0 in 0.515s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:34 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76 Apr 24 01:19:34 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:34 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76" returned: 0 in 0.412s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Lock "cinder-quobyte-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76" released by "delete_volume" :: held 0.983s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Created reservations ['3f511ded-c3d9-4e98-b70d-84adfae87046', '5bf2599b-fafe-4fb5-ad69-e9db5f44278e', '6c6088fa-994d-4324-8e14-2d2977b1fb0a', 'ea63afd4-9a7b-453f-835a-9a5c7baf3285'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:34 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:19:34 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:35 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.419s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:35 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:19:35 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Deleted volume successfully. Apr 24 01:19:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-4c5f928c-42d5-4e48-8d15-00afc0ed1926 tempest-VolumesNegativeTest-1723593206 None] Lock "cinder-92ea7af6-c6e3-4d8c-8e8c-3a7a9c092e76-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Flow 'volume_create_manager' (10bdc58d-aa88-4ae1-9e57-dd30e401e658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e073c1-4c0f-42fb-b1ad-e51aa840579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e073c1-4c0f-42fb-b1ad-e51aa840579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1937928536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629a7bc5-e839-469c-9115-737c654c39fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3779eef8d4144dc4a397a0a8797c33ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:38Z,use_quota=True,user_id='8c7952dbfeb64d40b48df2790c59ff0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a693f6-b008-4bc0-b413-0d639354c987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a693f6-b008-4bc0-b413-0d639354c987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96fbfea-7e77-4b5a-89c1-940a606e4bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96fbfea-7e77-4b5a-89c1-940a606e4bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629a7bc5-e839-469c-9115-737c654c39fb', 'volume_name': 'volume-629a7bc5-e839-469c-9115-737c654c39fb', 'volume_size': 2}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a6b032-7733-4c6c-84d1-ce9370911362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a6b032-7733-4c6c-84d1-ce9370911362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072b0401-5145-4f35-bdb4-d4380f63d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:38 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Volume 629a7bc5-e839-469c-9115-737c654c39fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629a7bc5-e839-469c-9115-737c654c39fb', 'volume_size': 2} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1937928536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629a7bc5-e839-469c-9115-737c654c39fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3779eef8d4144dc4a397a0a8797c33ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:38Z,use_quota=True,user_id='8c7952dbfeb64d40b48df2790c59ff0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Creating volume 629a7bc5-e839-469c-9115-737c654c39fb {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:19:38 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb 2147483648 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:38 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb 2147483648 Apr 24 01:19:38 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:38 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb 2147483648" returned: 0 in 0.661s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:38 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb Apr 24 01:19:38 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:39 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb" returned: 0 in 0.452s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:19:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072b0401-5145-4f35-bdb4-d4380f63d22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629a7bc5-e839-469c-9115-737c654c39fb', 'volume_size': 2}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92067b95-7b0a-4006-8ce4-95fa82a422da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:39 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Volume volume-629a7bc5-e839-469c-9115-737c654c39fb (629a7bc5-e839-469c-9115-737c654c39fb): created successfully Apr 24 01:19:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92067b95-7b0a-4006-8ce4-95fa82a422da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Flow 'volume_create_manager' (10bdc58d-aa88-4ae1-9e57-dd30e401e658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:19:39 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-3e36e2cc-735c-4b25-83db-3c5b0d993d9c tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Created volume successfully. Apr 24 01:19:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Creating offline snapshot 600cae43-a961-461c-928b-2b29e6a62646 of volume 629a7bc5-e839-469c-9115-737c654c39fb {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:19:40 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e04e7-a2b7-4d95-9d31-206e9c6aa53f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:19:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:40 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb Apr 24 01:19:40 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:40 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb" returned: 0 in 0.513s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 2G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:40 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 2G Apr 24 01:19:40 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:41 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 2G" returned: 0 in 0.692s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629a7bc5-e839-469c-9115-737c654c39fb -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:41 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629a7bc5-e839-469c-9115-737c654c39fb -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 Apr 24 01:19:41 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:42 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629a7bc5-e839-469c-9115-737c654c39fb -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646" returned: 0 in 0.471s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:42 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 is being set with open permissions: ugo+rw Apr 24 01:19:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:42 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 Apr 24 01:19:42 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:42 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646" returned: 0 in 0.440s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:42 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.info Apr 24 01:19:42 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:42 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.info" returned: 0 in 0.421s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:42 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.info is being set with open permissions: ugo+rw Apr 24 01:19:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:42 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.info Apr 24 01:19:42 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:43 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.info" returned: 0 in 0.403s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.043s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:43 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-fd71c820-7b99-4d4e-9ebb-2752fbd46ab6 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Create snapshot completed successfully Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "cinder-600cae43-a961-461c-928b-2b29e6a62646-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-600cae43-a961-461c-928b-2b29e6a62646-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "cinder-quobyte-629a7bc5-e839-469c-9115-737c654c39fb" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-quobyte-629a7bc5-e839-469c-9115-737c654c39fb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "cinder-quobyte-600cae43-a961-461c-928b-2b29e6a62646" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-quobyte-600cae43-a961-461c-928b-2b29e6a62646" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Deleting offline snapshot 600cae43-a961-461c-928b-2b29e6a62646 of volume 629a7bc5-e839-469c-9115-737c654c39fb {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] snapshot_file for this snap is: volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56867a0-cad5-448c-a40c-0f102cd8ddf8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:19:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:44 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 Apr 24 01:19:44 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:45 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646" returned: 0 in 0.488s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-629a7bc5-e839-469c-9115-737c654c39fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:19:45 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad6992b-a486-420d-9295-35a6fbe720b1]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:19:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:45 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb Apr 24 01:19:45 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:45 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb" returned: 0 in 0.486s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:45 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 Apr 24 01:19:45 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:46 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646" returned: 0 in 0.542s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:46 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646 Apr 24 01:19:46 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:46 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb.600cae43-a961-461c-928b-2b29e6a62646" returned: 0 in 0.444s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-quobyte-600cae43-a961-461c-928b-2b29e6a62646" released by "_delete_snapshot" :: held 2.083s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:19:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-quobyte-629a7bc5-e839-469c-9115-737c654c39fb" released by "delete_snapshot" :: held 2.122s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:19:46 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Created reservations ['185f6a29-edba-45d6-b9e3-963b47f447c7', '1e6e5ae5-5664-460f-b550-7c2223eb9f8a', 'cc58e6c7-8c01-40af-892d-61b16bdb52d8', '31ec5073-5280-41a1-91b2-dafa575c5f48'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:19:46 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Delete snapshot completed successfully. Apr 24 01:19:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-df6f09c2-2699-42f1-8294-93d91bf01f21 tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-600cae43-a961-461c-928b-2b29e6a62646-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:19:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "cinder-629a7bc5-e839-469c-9115-737c654c39fb-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:19:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-629a7bc5-e839-469c-9115-737c654c39fb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:19:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "cinder-quobyte-629a7bc5-e839-469c-9115-737c654c39fb" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:19:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-quobyte-629a7bc5-e839-469c-9115-737c654c39fb" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:19:47 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf549c0-5d57-46e0-9342-8a4daccb3657]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:19:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:47 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb Apr 24 01:19:47 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:48 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb" returned: 0 in 0.523s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:48 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb Apr 24 01:19:48 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:48 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-629a7bc5-e839-469c-9115-737c654c39fb" returned: 0 in 0.499s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-quobyte-629a7bc5-e839-469c-9115-737c654c39fb" released by "delete_volume" :: held 1.085s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:19:48 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Created reservations ['0da29f39-4243-4535-b598-b747a385f379', '523d6522-7232-4298-a3ea-110f0b033073', '3532b244-6132-4f09-b9cc-3d04eb0a6763', '9b7b2643-087d-49a7-9227-709b78ce944a'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:49 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:19:49 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:49 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.445s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:19:49 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Deleted volume successfully. Apr 24 01:19:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-29e8a05f-4535-445f-bc9e-fd4b66bd025a tempest-VolumesSnapshotNegativeTestJSON-1443404052 None] Lock "cinder-629a7bc5-e839-469c-9115-737c654c39fb-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Flow 'volume_create_manager' (d7a7e5a0-67f2-48e7-8cbb-0670098ae1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4d525e-a966-4c0c-9dac-35e58dba5eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4d525e-a966-4c0c-9dac-35e58dba5eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24b264a-c239-437b-b0bf-c9d0937d0b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdac578f54f40d48d185e13c11c8c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:52Z,use_quota=True,user_id='6479cd8aaddf4fc2b3715e3b35c55735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2030da5b-d738-4630-9b98-393bcbc695a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2030da5b-d738-4630-9b98-393bcbc695a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f329fe4-47b2-4f39-99fd-2abc448bac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f329fe4-47b2-4f39-99fd-2abc448bac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24b264a-c239-437b-b0bf-c9d0937d0b8d', 'volume_name': 'volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5bb78c-38fe-42fe-8509-0feef1f263d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5bb78c-38fe-42fe-8509-0feef1f263d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebbe32f-c8f1-4b58-b092-edfcb6d4b19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:52 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Volume c24b264a-c239-437b-b0bf-c9d0937d0b8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d', 'volume_size': 1} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24b264a-c239-437b-b0bf-c9d0937d0b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdac578f54f40d48d185e13c11c8c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:52Z,use_quota=True,user_id='6479cd8aaddf4fc2b3715e3b35c55735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Creating volume c24b264a-c239-437b-b0bf-c9d0937d0b8d {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:19:52 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:52 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d 1073741824 Apr 24 01:19:52 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:52 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d 1073741824" returned: 0 in 0.607s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:53 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d Apr 24 01:19:53 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:53 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d" returned: 0 in 0.437s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:19:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebbe32f-c8f1-4b58-b092-edfcb6d4b19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3693ea3-544d-4352-960b-5f305e6a0ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:53 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Volume volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d (c24b264a-c239-437b-b0bf-c9d0937d0b8d): created successfully Apr 24 01:19:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3693ea3-544d-4352-960b-5f305e6a0ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:53 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Flow 'volume_create_manager' (d7a7e5a0-67f2-48e7-8cbb-0670098ae1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:19:53 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-614b1179-453d-4bc9-9df2-bbf1ea482e42 tempest-CinderUnicodeTest-1293337058 None] Created volume successfully. Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Flow 'volume_create_manager' (a7e74ec3-88f5-4948-b0db-aa530bf64fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9722d4-40ad-44c2-bc41-e0794a017cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9722d4-40ad-44c2-bc41-e0794a017cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:19:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-887655696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddcb293-443e-46e6-9fd9-8bdabf010a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdac578f54f40d48d185e13c11c8c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:55Z,use_quota=True,user_id='6479cd8aaddf4fc2b3715e3b35c55735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cf21b5-379e-4462-bf7d-265b3eab2174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cf21b5-379e-4462-bf7d-265b3eab2174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7512eeb-1dd2-4d00-8d1a-97b2ffc14089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7512eeb-1dd2-4d00-8d1a-97b2ffc14089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ddcb293-443e-46e6-9fd9-8bdabf010a22', 'volume_name': 'volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c726512a-535f-4c69-a799-50c22c28743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c726512a-535f-4c69-a799-50c22c28743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1b46ed-fb8c-48ff-a194-eaeba664bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:54 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Volume 9ddcb293-443e-46e6-9fd9-8bdabf010a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22', 'volume_size': 1} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:19:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-887655696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddcb293-443e-46e6-9fd9-8bdabf010a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdac578f54f40d48d185e13c11c8c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:19:55Z,use_quota=True,user_id='6479cd8aaddf4fc2b3715e3b35c55735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Creating volume 9ddcb293-443e-46e6-9fd9-8bdabf010a22 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:19:54 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:19:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:54 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 1073741824 Apr 24 01:19:54 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:55 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 1073741824" returned: 0 in 0.588s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:55 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 Apr 24 01:19:55 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:55 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22" returned: 0 in 0.417s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1b46ed-fb8c-48ff-a194-eaeba664bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b41aea3-b77b-41ef-8ae3-088b75fde884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:19:55 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Volume volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 (9ddcb293-443e-46e6-9fd9-8bdabf010a22): created successfully Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b41aea3-b77b-41ef-8ae3-088b75fde884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:19:55 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Flow 'volume_create_manager' (a7e74ec3-88f5-4948-b0db-aa530bf64fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:19:55 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-04c6d374-5462-46ce-b21d-4b21d61d99e4 tempest-CinderUnicodeTest-1293337058 None] Created volume successfully. Apr 24 01:19:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:19:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:19:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Creating offline snapshot e2d7c888-eba7-43f2-bfb3-e7e7037c5598 of volume 9ddcb293-443e-46e6-9fd9-8bdabf010a22 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:19:57 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ee257b-ab35-443f-8366-7f8e0ae4a617]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:19:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:57 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 Apr 24 01:19:57 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:57 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22" returned: 0 in 0.495s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:57 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 1G Apr 24 01:19:57 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:58 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 1G" returned: 0 in 0.578s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:58 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 Apr 24 01:19:58 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:58 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598" returned: 0 in 0.476s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:58 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 is being set with open permissions: ugo+rw Apr 24 01:19:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:58 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 Apr 24 01:19:58 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:59 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598" returned: 0 in 0.417s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:59 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.info Apr 24 01:19:59 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:19:59 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 24 01:19:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.info" returned: 0 in 0.449s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:19:59 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.info is being set with open permissions: ugo+rw Apr 24 01:19:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:19:59 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.info Apr 24 01:19:59 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:00 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.info" returned: 0 in 0.420s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:00 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-029125ba-1436-4346-9f97-afee14be64c1 tempest-CinderUnicodeTest-1293337058 None] Create snapshot completed successfully Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "cinder-e2d7c888-eba7-43f2-bfb3-e7e7037c5598-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-e2d7c888-eba7-43f2-bfb3-e7e7037c5598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "cinder-quobyte-9ddcb293-443e-46e6-9fd9-8bdabf010a22" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-quobyte-9ddcb293-443e-46e6-9fd9-8bdabf010a22" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "cinder-quobyte-e2d7c888-eba7-43f2-bfb3-e7e7037c5598" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-quobyte-e2d7c888-eba7-43f2-bfb3-e7e7037c5598" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Deleting offline snapshot e2d7c888-eba7-43f2-bfb3-e7e7037c5598 of volume 9ddcb293-443e-46e6-9fd9-8bdabf010a22 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] snapshot_file for this snap is: volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4bb1d0-4027-4f4c-b66e-6973c33d3e09]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:00 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 Apr 24 01:20:00 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:00 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598" returned: 0 in 0.485s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe31cf4-e2de-440d-b2f3-980323faebbf]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:00 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 Apr 24 01:20:00 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:01 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22" returned: 0 in 0.515s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:01 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 Apr 24 01:20:01 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:01 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598" returned: 0 in 0.557s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:01 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598 Apr 24 01:20:02 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:02 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22.e2d7c888-eba7-43f2-bfb3-e7e7037c5598" returned: 0 in 0.469s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-quobyte-e2d7c888-eba7-43f2-bfb3-e7e7037c5598" released by "_delete_snapshot" :: held 2.130s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-quobyte-9ddcb293-443e-46e6-9fd9-8bdabf010a22" released by "delete_snapshot" :: held 2.153s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:02 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Created reservations ['e5188050-77c2-4838-be8b-a66ef4ab97d0', '763e4747-0cf1-4b04-bdfc-525a50f00de5', '13a31f9f-3c29-4c8b-b9e6-55ab9441703f', '423616ae-0ea5-4445-b6e2-05176daa1445'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:20:02 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Delete snapshot completed successfully. Apr 24 01:20:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-203d0a4b-ce17-4354-92ab-0551c7d856d8 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-e2d7c888-eba7-43f2-bfb3-e7e7037c5598-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "cinder-9ddcb293-443e-46e6-9fd9-8bdabf010a22-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-9ddcb293-443e-46e6-9fd9-8bdabf010a22-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "cinder-quobyte-9ddcb293-443e-46e6-9fd9-8bdabf010a22" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-quobyte-9ddcb293-443e-46e6-9fd9-8bdabf010a22" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:03 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed42c4d-1f1c-4569-ab6c-0dfcdc6f0a0a]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:03 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 Apr 24 01:20:03 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:04 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22" returned: 0 in 0.578s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:04 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22 Apr 24 01:20:04 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:04 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-9ddcb293-443e-46e6-9fd9-8bdabf010a22" returned: 0 in 0.479s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-quobyte-9ddcb293-443e-46e6-9fd9-8bdabf010a22" released by "delete_volume" :: held 1.116s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Created reservations ['e0c6bee4-c2eb-4ee8-97a6-ada5b0efb46d', 'f8673e7e-c52a-454d-8640-9836f3f22e48', '3383cb11-5ddc-4776-b860-acded714e4e1', '4647c8fd-e684-44e5-a7fa-d6e638bf6490'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:04 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:20:04 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:05 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.433s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:20:05 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Deleted volume successfully. Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-21db623c-fb94-4403-881a-2115b691fe25 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-9ddcb293-443e-46e6-9fd9-8bdabf010a22-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "cinder-c24b264a-c239-437b-b0bf-c9d0937d0b8d-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-c24b264a-c239-437b-b0bf-c9d0937d0b8d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "cinder-quobyte-c24b264a-c239-437b-b0bf-c9d0937d0b8d" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-quobyte-c24b264a-c239-437b-b0bf-c9d0937d0b8d" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6890939-aa9f-438e-982f-da324536f6ae]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:05 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d Apr 24 01:20:05 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:06 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d" returned: 0 in 0.513s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:06 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d Apr 24 01:20:06 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:06 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c24b264a-c239-437b-b0bf-c9d0937d0b8d" returned: 0 in 0.433s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-quobyte-c24b264a-c239-437b-b0bf-c9d0937d0b8d" released by "delete_volume" :: held 0.985s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Created reservations ['559b1253-e13d-4910-93b0-aabd85042c83', '1acb83e7-0ea9-46d6-98e4-55fced285b46', '8d373e8d-8225-4110-96de-932330c94be3', '016abe8e-66a2-42e9-894e-877bf7e2a42e'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:06 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:20:06 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:07 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.426s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:07 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:20:07 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Deleted volume successfully. Apr 24 01:20:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b87e2b3-8d40-4e6c-9b65-540c48b97ca2 tempest-CinderUnicodeTest-1293337058 None] Lock "cinder-c24b264a-c239-437b-b0bf-c9d0937d0b8d-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:20:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:20:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:20:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:11 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:20:11 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:12 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.466s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:20:16 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=56,cinder:SELECT=45,cinder:INSERT=13,cinder:DELETE=6 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:20:17 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=43,cinder:INSERT=16,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Flow 'volume_create_manager' (3f3e7593-0507-47c4-a873-53a4c1dd718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa495d8-3ae7-41c7-837d-f9a866854a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa495d8-3ae7-41c7-837d-f9a866854a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-933996605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b01b507-9eb1-4d02-94e0-9404f68f9856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e954e85c197240cc9b86d6425ad7cc65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:27Z,use_quota=True,user_id='b3af5c36273e4a2499bac8ff2d0fe66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7197d538-af7a-4039-b0b7-20e79d40afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7197d538-af7a-4039-b0b7-20e79d40afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7752193-249b-4b0e-8a3e-62c72d6fff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7752193-249b-4b0e-8a3e-62c72d6fff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b01b507-9eb1-4d02-94e0-9404f68f9856', 'volume_name': 'volume-1b01b507-9eb1-4d02-94e0-9404f68f9856', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956970e0-a978-42ab-8eb2-f566d76dff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956970e0-a978-42ab-8eb2-f566d76dff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f20f3a-b54e-4282-a488-a758e9d761ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:27 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Volume 1b01b507-9eb1-4d02-94e0-9404f68f9856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b01b507-9eb1-4d02-94e0-9404f68f9856', 'volume_size': 1} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-933996605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b01b507-9eb1-4d02-94e0-9404f68f9856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e954e85c197240cc9b86d6425ad7cc65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:27Z,use_quota=True,user_id='b3af5c36273e4a2499bac8ff2d0fe66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Creating volume 1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:20:27 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:27 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 1073741824 Apr 24 01:20:27 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:27 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 1073741824" returned: 0 in 0.615s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:27 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 Apr 24 01:20:27 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:28 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856" returned: 0 in 0.446s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:20:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f20f3a-b54e-4282-a488-a758e9d761ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b01b507-9eb1-4d02-94e0-9404f68f9856', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f9c6a8-c66f-4390-820d-28fcf3385de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:28 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Volume volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 (1b01b507-9eb1-4d02-94e0-9404f68f9856): created successfully Apr 24 01:20:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f9c6a8-c66f-4390-820d-28fcf3385de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:28 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Flow 'volume_create_manager' (3f3e7593-0507-47c4-a873-53a4c1dd718f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:20:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5be6c7ea-5891-49d9-8704-d399b36db873 tempest-SnapshotDependencyTests-650147391 None] Created volume successfully. Apr 24 01:20:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:29 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Creating offline snapshot bc2b05f9-9d7c-4528-b1b5-a3230d49d932 of volume 1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:20:29 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc63cdde-ece0-4c9f-8f6a-035ba9cd4cbb]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:29 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 Apr 24 01:20:29 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:30 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856" returned: 0 in 0.536s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:30 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 1G Apr 24 01:20:30 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:30 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 1G" returned: 0 in 0.602s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:30 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 Apr 24 01:20:30 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:31 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932" returned: 0 in 0.465s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:31 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 is being set with open permissions: ugo+rw Apr 24 01:20:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:31 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 Apr 24 01:20:31 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:31 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932" returned: 0 in 0.480s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:31 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.info Apr 24 01:20:31 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:32 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.info" returned: 0 in 0.450s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:32 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.info is being set with open permissions: ugo+rw Apr 24 01:20:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:32 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.info Apr 24 01:20:32 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:32 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.info" returned: 0 in 0.438s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:32 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-39bab03e-ce87-4e1e-95e0-c7444a539a0d tempest-SnapshotDependencyTests-650147391 None] Create snapshot completed successfully Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Flow 'volume_create_manager' (a9b32dd0-351a-4c9b-853b-8707ed303c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0dd3d54-369a-4a71-9094-2dd2aa9e319d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0dd3d54-369a-4a71-9094-2dd2aa9e319d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e954e85c197240cc9b86d6425ad7cc65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc2b05f9-9d7c-4528-b1b5-a3230d49d932,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:20:34Z,use_quota=True,user_id='b3af5c36273e4a2499bac8ff2d0fe66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4f7cc9-bdc9-404c-8162-d870bbc078fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4f7cc9-bdc9-404c-8162-d870bbc078fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8105bc-a9f7-4dc6-8055-34bdfd07f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8105bc-a9f7-4dc6-8055-34bdfd07f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5', 'volume_name': 'volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5', 'volume_size': 1, 'snapshot_id': 'bc2b05f9-9d7c-4528-b1b5-a3230d49d932'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345a4623-bc74-453a-a11e-897133e1fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345a4623-bc74-453a-a11e-897133e1fb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcbc850-2828-4de5-9882-4709739aab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:34 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Volume 270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5', 'volume_size': 1, 'snapshot_id': 'bc2b05f9-9d7c-4528-b1b5-a3230d49d932'} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-quobyte-bc2b05f9-9d7c-4528-b1b5-a3230d49d932-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" by "_create_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-bc2b05f9-9d7c-4528-b1b5-a3230d49d932-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Creating volume 270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 from snapshot bc2b05f9-9d7c-4528-b1b5-a3230d49d932 {{(pid=81925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-quobyte-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] snapshot: bc2b05f9-9d7c-4528-b1b5-a3230d49d932, volume: 270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ce147-102a-4ea4-9d80-98f95f05e161]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:34 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 Apr 24 01:20:34 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:35 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932" returned: 0 in 0.521s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b01b507-9eb1-4d02-94e0-9404f68f9856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f53a3a-8a28-49cc-abe7-59e7c63d35bc]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:35 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 Apr 24 01:20:35 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:35 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856" returned: 0 in 0.538s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:20:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:35 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 Apr 24 01:20:35 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:39 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" returned: 0 in 4.420s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:40 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed672b84-71a4-4c0b-aab1-3fdde35285e3]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:40 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 Apr 24 01:20:40 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:40 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856" returned: 0 in 0.646s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:40 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:20:40 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Converted 1024.00 MB image at 231.63 MB/s Apr 24 01:20:40 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 is being set with open permissions: ugo+rw Apr 24 01:20:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:40 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 Apr 24 01:20:40 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:41 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" returned: 0 in 0.438s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" released by "_copy_volume_from_snapshot" :: held 6.659s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-bc2b05f9-9d7c-4528-b1b5-a3230d49d932-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" released by "_create_volume_from_snapshot" :: held 6.691s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.706s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcbc850-2828-4de5-9882-4709739aab06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5', 'volume_size': 1, 'snapshot_id': 'bc2b05f9-9d7c-4528-b1b5-a3230d49d932'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769017ab-1653-470c-864a-8111cc011ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:20:41 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Volume volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 (270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5): created successfully Apr 24 01:20:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769017ab-1653-470c-864a-8111cc011ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:20:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Flow 'volume_create_manager' (a9b32dd0-351a-4c9b-853b-8707ed303c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:20:41 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-53bbc0d3-0430-41ee-8914-700ebdfe3267 tempest-SnapshotDependencyTests-650147391 None] Created volume successfully. Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-bc2b05f9-9d7c-4528-b1b5-a3230d49d932-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-bc2b05f9-9d7c-4528-b1b5-a3230d49d932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-quobyte-1b01b507-9eb1-4d02-94e0-9404f68f9856" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-1b01b507-9eb1-4d02-94e0-9404f68f9856" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-quobyte-bc2b05f9-9d7c-4528-b1b5-a3230d49d932" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-bc2b05f9-9d7c-4528-b1b5-a3230d49d932" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Deleting offline snapshot bc2b05f9-9d7c-4528-b1b5-a3230d49d932 of volume 1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] snapshot_file for this snap is: volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eae1aaa-6706-4e2f-9c87-e2bb043a3e40]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:42 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 Apr 24 01:20:42 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:42 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932" returned: 0 in 0.527s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b01b507-9eb1-4d02-94e0-9404f68f9856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edaf410-8e78-4269-86df-1a4b070c6513]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:42 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 Apr 24 01:20:42 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:43 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856" returned: 0 in 0.498s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:43 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 Apr 24 01:20:43 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:43 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932" returned: 0 in 0.570s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:43 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932 Apr 24 01:20:43 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:44 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856.bc2b05f9-9d7c-4528-b1b5-a3230d49d932" returned: 0 in 0.444s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-bc2b05f9-9d7c-4528-b1b5-a3230d49d932" released by "_delete_snapshot" :: held 2.156s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-1b01b507-9eb1-4d02-94e0-9404f68f9856" released by "delete_snapshot" :: held 2.182s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:44 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Created reservations ['b232a8c8-93a9-41ca-9961-7c8c2dace402', '3e56608f-5b47-4804-b142-f71ce16b904d', '5df9ef1d-03c1-489f-88ef-0a152746d3a7', 'f8d308d3-3e24-4778-8ff4-3eb1b1e465de'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:20:44 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Delete snapshot completed successfully. Apr 24 01:20:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-3887b8ab-90c2-47ca-a3d7-08a743ad98d3 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-bc2b05f9-9d7c-4528-b1b5-a3230d49d932-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-1b01b507-9eb1-4d02-94e0-9404f68f9856-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-1b01b507-9eb1-4d02-94e0-9404f68f9856-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-quobyte-1b01b507-9eb1-4d02-94e0-9404f68f9856" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-1b01b507-9eb1-4d02-94e0-9404f68f9856" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:45 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0eeced-279a-4c67-8adc-3e89f7215d9f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:45 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 Apr 24 01:20:45 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:45 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856" returned: 0 in 0.510s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:45 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856 Apr 24 01:20:45 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:46 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-1b01b507-9eb1-4d02-94e0-9404f68f9856" returned: 0 in 0.468s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-1b01b507-9eb1-4d02-94e0-9404f68f9856" released by "delete_volume" :: held 1.036s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Created reservations ['94e658f7-279f-41f2-95a1-f662983c0b45', 'fc4e3c42-3872-4a84-af36-cc139c92bfff', '13587c6b-6066-4d86-980d-ac121612a88c', '67fe262d-4ece-4b4f-8dc9-b778103906cb'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:46 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:20:46 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:46 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.443s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:20:46 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Deleted volume successfully. Apr 24 01:20:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fe66d9a4-107a-4485-9474-d1235920c604 tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-1b01b507-9eb1-4d02-94e0-9404f68f9856-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "cinder-quobyte-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:20:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:20:47 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1836d4cd-e69b-490e-b34b-28a8fd7d5218]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:20:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:47 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 Apr 24 01:20:47 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:48 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" returned: 0 in 0.538s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:48 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5 Apr 24 01:20:48 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:48 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" returned: 0 in 0.420s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-quobyte-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5" released by "delete_volume" :: held 0.997s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Created reservations ['52e28138-6885-49c4-9336-f2557aeabe31', '39d1bad2-b8bf-4cd8-a5a3-68c062375168', '9060f53e-bdb4-41fc-8b72-8e457409cdb5', '533edf7a-46e3-4e07-b845-c72c2d038f68'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:20:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:20:48 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:20:48 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:20:49 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 24 01:20:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.483s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:20:49 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:20:49 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Deleted volume successfully. Apr 24 01:20:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-02e3543a-1c31-42ab-b44c-7ea3f62cecfc tempest-SnapshotDependencyTests-650147391 None] Lock "cinder-270ecdc7-b9d9-4dba-ad7e-e82d7cbe4ca5-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:20:58 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=21,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=4 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:20:59 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=10,cinder:DELETE=2 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (8c779f28-5d17-4e8f-9c50-1b22648473cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d541f1a9-1cc5-49f1-8390-1c6bc57ac808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d541f1a9-1cc5-49f1-8390-1c6bc57ac808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272641082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e099f3a3-489c-40af-ad52-5fb717772bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9b0efc-9c98-4fad-86a3-72c00c46f666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9b0efc-9c98-4fad-86a3-72c00c46f666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c243252-23d4-4fe3-9e08-3132d3ba7e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c243252-23d4-4fe3-9e08-3132d3ba7e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e099f3a3-489c-40af-ad52-5fb717772bdb', 'volume_name': 'volume-e099f3a3-489c-40af-ad52-5fb717772bdb', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16815232-fe70-45eb-aa34-d509539cf4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16815232-fe70-45eb-aa34-d509539cf4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21ea773-6be7-4c8c-85bf-50da666175cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Volume e099f3a3-489c-40af-ad52-5fb717772bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e099f3a3-489c-40af-ad52-5fb717772bdb', 'volume_size': 1} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272641082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e099f3a3-489c-40af-ad52-5fb717772bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Creating volume e099f3a3-489c-40af-ad52-5fb717772bdb {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:05 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:05 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb 1073741824 Apr 24 01:21:05 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Flow 'volume_create_manager' (cfb4ae43-e96e-4388-a271-fdc6f79a8087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54e21ee-8394-4b1c-9b6b-d0c7d514a7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54e21ee-8394-4b1c-9b6b-d0c7d514a7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1532665021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b16198-8541-4324-830f-962b32b1a70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9891af30ffa49b58762b2b313361e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='433282e567cf4532b9a642f4e3ed2294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a593b4-04b9-4aed-b1d4-1f3d783f365f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a593b4-04b9-4aed-b1d4-1f3d783f365f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4e71c5-0079-4071-ad68-5d3c4afe886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4e71c5-0079-4071-ad68-5d3c4afe886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b16198-8541-4324-830f-962b32b1a70a', 'volume_name': 'volume-79b16198-8541-4324-830f-962b32b1a70a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0a476d-38c3-42c2-b7f1-1f0ff904f5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0a476d-38c3-42c2-b7f1-1f0ff904f5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa817be-c718-4dd7-bec7-9f78a6207d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Volume 79b16198-8541-4324-830f-962b32b1a70a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b16198-8541-4324-830f-962b32b1a70a', 'volume_size': 1} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (f4be476d-8c9f-49e5-883e-13ff863915ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6b8eb4-ca1c-4939-a48b-21669b49403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6b8eb4-ca1c-4939-a48b-21669b49403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1594457099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902b41d2-ebe0-4bb5-aa59-fb69a649c566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56161dc-1473-4e6c-9010-d59c6582d628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56161dc-1473-4e6c-9010-d59c6582d628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c2a4b1-d703-411e-bf6d-7e79a88c38ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c2a4b1-d703-411e-bf6d-7e79a88c38ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902b41d2-ebe0-4bb5-aa59-fb69a649c566', 'volume_name': 'volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252c70bb-f06d-44d9-8e68-8684c98fa681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252c70bb-f06d-44d9-8e68-8684c98fa681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b2c84d-9f97-40c5-9d15-6acf09ae3f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume 902b41d2-ebe0-4bb5-aa59-fb69a649c566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566', 'volume_size': 1} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (58ab1f62-f6be-4380-bfe6-bcf5a4ebeee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e522d6d3-4300-4f95-8307-86f896f3b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e522d6d3-4300-4f95-8307-86f896f3b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139734349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3e789b-e5e4-4b34-b2a6-da5f96a5de95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593727c5-4a54-4d3f-b67d-acbcbceceafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593727c5-4a54-4d3f-b67d-acbcbceceafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ef584c-9b0a-473b-a8aa-fed729c71a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ef584c-9b0a-473b-a8aa-fed729c71a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3e789b-e5e4-4b34-b2a6-da5f96a5de95', 'volume_name': 'volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1dbc49-15c8-483f-9c8d-5adde3afe54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1dbc49-15c8-483f-9c8d-5adde3afe54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27afcb9e-f9f8-4254-acc2-68770424aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:05 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Volume 0c3e789b-e5e4-4b34-b2a6-da5f96a5de95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95', 'volume_size': 1} Apr 24 01:21:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (f6c4d9ef-6558-4084-b199-f2b741069f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a85bdfd-2f3d-46b5-994f-75f695303b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a85bdfd-2f3d-46b5-994f-75f695303b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-412016411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8f496a-c4de-4a04-a5fc-b3325046f39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae4e9fb-2278-492b-8460-e0609581227f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae4e9fb-2278-492b-8460-e0609581227f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d46d717-45e7-40ed-9fb9-b14dec99457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d46d717-45e7-40ed-9fb9-b14dec99457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab8f496a-c4de-4a04-a5fc-b3325046f39f', 'volume_name': 'volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea923dcd-b95e-4df6-9b59-67484f503503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea923dcd-b95e-4df6-9b59-67484f503503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a17330-0530-44ca-ba91-1bdd3818510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Volume ab8f496a-c4de-4a04-a5fc-b3325046f39f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f', 'volume_size': 1} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:06 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (a7c66595-e329-4927-8c39-d0bd55555795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45472cf8-beb9-4b68-b14f-48af888b2f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb 1073741824" returned: 0 in 1.269s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45472cf8-beb9-4b68-b14f-48af888b2f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-702713931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a60835-fc01-454b-9de6-3bae33ef0f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f54c9c3-4927-4eb4-8507-3a9345831172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f54c9c3-4927-4eb4-8507-3a9345831172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b38372-c052-48d5-8f72-4c859d4d5a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b38372-c052-48d5-8f72-4c859d4d5a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a60835-fc01-454b-9de6-3bae33ef0f0e', 'volume_name': 'volume-01a60835-fc01-454b-9de6-3bae33ef0f0e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba5a8c6-f6cf-4a80-80b2-9ccd5575743c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba5a8c6-f6cf-4a80-80b2-9ccd5575743c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca81be6-6096-4d2b-b856-23e9065f78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Volume 01a60835-fc01-454b-9de6-3bae33ef0f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a60835-fc01-454b-9de6-3bae33ef0f0e', 'volume_size': 1} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:06 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb Apr 24 01:21:06 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (a3438c72-c6f3-4f10-8fce-b02f5ea3ac67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74809bb-4ded-4f26-906b-ff54e8d5fcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74809bb-4ded-4f26-906b-ff54e8d5fcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1120903916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8143e04-8ad9-45ef-aec2-1eafcc120d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:07Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289006f1-cf53-45c9-81c0-12390b3051de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289006f1-cf53-45c9-81c0-12390b3051de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e87124-8695-49f8-9869-b39251ec896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e87124-8695-49f8-9869-b39251ec896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8143e04-8ad9-45ef-aec2-1eafcc120d45', 'volume_name': 'volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cbd03d-bf93-4226-af28-d575b7d80a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cbd03d-bf93-4226-af28-d575b7d80a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cba907a-0d34-4d0a-bb12-df291054105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:06 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Volume b8143e04-8ad9-45ef-aec2-1eafcc120d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45', 'volume_size': 1} Apr 24 01:21:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:07 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb" returned: 0 in 0.534s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.731s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1532665021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b16198-8541-4324-830f-962b32b1a70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9891af30ffa49b58762b2b313361e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:05Z,use_quota=True,user_id='433282e567cf4532b9a642f4e3ed2294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Creating volume 79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:07 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21ea773-6be7-4c8c-85bf-50da666175cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e099f3a3-489c-40af-ad52-5fb717772bdb', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:07 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a 1073741824 Apr 24 01:21:07 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bb1585-4b8f-4ae5-a7cb-62dd0e1a13ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:07 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Volume volume-e099f3a3-489c-40af-ad52-5fb717772bdb (e099f3a3-489c-40af-ad52-5fb717772bdb): created successfully Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bb1585-4b8f-4ae5-a7cb-62dd0e1a13ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (8c779f28-5d17-4e8f-9c50-1b22648473cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:07 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5eabc683-cc70-4bf0-87a5-d7f67d567cda tempest-CreateVolumesFromImageTest-1269884142 None] Created volume successfully. Apr 24 01:21:07 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a 1073741824" returned: 0 in 0.760s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:08 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a Apr 24 01:21:08 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:08 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a" returned: 0 in 0.520s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.704s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1594457099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902b41d2-ebe0-4bb5-aa59-fb69a649c566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Creating volume 902b41d2-ebe0-4bb5-aa59-fb69a649c566 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:08 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:08 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 1073741824 Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa817be-c718-4dd7-bec7-9f78a6207d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b16198-8541-4324-830f-962b32b1a70a', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:08 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22977b2-98f7-46e7-a6e9-f5a142521c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:08 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Volume volume-79b16198-8541-4324-830f-962b32b1a70a (79b16198-8541-4324-830f-962b32b1a70a): created successfully Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22977b2-98f7-46e7-a6e9-f5a142521c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:08 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Flow 'volume_create_manager' (cfb4ae43-e96e-4388-a271-fdc6f79a8087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:08 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9fcc8c0f-f144-434e-9b60-75f771814dd3 tempest-VolumeDependencyTests-1497362426 None] Created volume successfully. Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:09 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 1073741824" returned: 0 in 0.789s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:09 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 Apr 24 01:21:09 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:09 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566" returned: 0 in 0.546s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.947s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139734349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3e789b-e5e4-4b34-b2a6-da5f96a5de95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Creating volume 0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:09 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:09 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 1073741824 Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b2c84d-9f97-40c5-9d15-6acf09ae3f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:09 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4099f275-2b4b-407b-8a53-3d0a85ffd0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:09 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 (902b41d2-ebe0-4bb5-aa59-fb69a649c566): created successfully Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4099f275-2b4b-407b-8a53-3d0a85ffd0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:09 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (f4be476d-8c9f-49e5-883e-13ff863915ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:09 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-52102e43-5266-4e0b-b134-13763304a339 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created volume successfully. Apr 24 01:21:10 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 1073741824" returned: 0 in 0.723s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:10 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 Apr 24 01:21:10 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:11 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95" returned: 0 in 0.645s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.137s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-412016411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8f496a-c4de-4a04-a5fc-b3325046f39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Creating volume ab8f496a-c4de-4a04-a5fc-b3325046f39f {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:11 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:11 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f 1073741824 Apr 24 01:21:11 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27afcb9e-f9f8-4254-acc2-68770424aacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d693d306-3f46-4ea4-9348-810a3d130460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:11 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Volume volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 (0c3e789b-e5e4-4b34-b2a6-da5f96a5de95): created successfully Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d693d306-3f46-4ea4-9348-810a3d130460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (58ab1f62-f6be-4380-bfe6-bcf5a4ebeee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:11 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e99d5549-5d24-4afd-9612-750d420089f5 tempest-CreateVolumesFromImageTest-1269884142 None] Created volume successfully. Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:11 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:11 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:12 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f 1073741824" returned: 0 in 0.784s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:12 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f Apr 24 01:21:12 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:12 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.643s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:12 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f" returned: 0 in 0.657s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.230s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-702713931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a60835-fc01-454b-9de6-3bae33ef0f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:06Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Creating volume 01a60835-fc01-454b-9de6-3bae33ef0f0e {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:12 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:12 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e 1073741824 Apr 24 01:21:12 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a17330-0530-44ca-ba91-1bdd3818510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9da83e-90ed-4240-a499-9dc1cac2867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:12 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Volume volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f (ab8f496a-c4de-4a04-a5fc-b3325046f39f): created successfully Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9da83e-90ed-4240-a499-9dc1cac2867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (f6c4d9ef-6558-4084-b199-f2b741069f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:12 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-187e150b-2d79-47de-8c2d-028d5d874de7 tempest-CreateVolumesFromImageTest-1269884142 None] Created volume successfully. Apr 24 01:21:13 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e 1073741824" returned: 0 in 0.791s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:13 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e Apr 24 01:21:13 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:14 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e" returned: 0 in 0.486s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.280s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1120903916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8143e04-8ad9-45ef-aec2-1eafcc120d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3f06a7775e4ec6af6f7ec31ffe87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:07Z,use_quota=True,user_id='9012e734af1e48629def1e4626c2325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Creating volume b8143e04-8ad9-45ef-aec2-1eafcc120d45 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:14 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca81be6-6096-4d2b-b856-23e9065f78cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a60835-fc01-454b-9de6-3bae33ef0f0e', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08aeac6-003f-421e-bd2e-a1c48328c5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:14 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 1073741824 Apr 24 01:21:14 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:14 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Volume volume-01a60835-fc01-454b-9de6-3bae33ef0f0e (01a60835-fc01-454b-9de6-3bae33ef0f0e): created successfully Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08aeac6-003f-421e-bd2e-a1c48328c5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (a7c66595-e329-4927-8c39-d0bd55555795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:14 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c4abdf52-61f3-4b41-97c3-3365a4ad8f9c tempest-CreateVolumesFromImageTest-1269884142 None] Created volume successfully. Apr 24 01:21:14 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 1073741824" returned: 0 in 0.729s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:14 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 Apr 24 01:21:14 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:15 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45" returned: 0 in 0.482s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.306s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cba907a-0d34-4d0a-bb12-df291054105e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbf255f-a604-42c4-b262-4b054a0b08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Creating offline snapshot f7353ed2-5d8f-407e-b35d-d2e81951212d of volume 79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:21:15 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Volume volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 (b8143e04-8ad9-45ef-aec2-1eafcc120d45): created successfully Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbf255f-a604-42c4-b262-4b054a0b08e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Flow 'volume_create_manager' (a3438c72-c6f3-4f10-8fce-b02f5ea3ac67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc8c625-45f2-4745-957f-6ef13849e074]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:15 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0f70a6a4-5f6c-409c-8cbb-39d54fd7af84 tempest-CreateVolumesFromImageTest-1269884142 None] Created volume successfully. Apr 24 01:21:15 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a Apr 24 01:21:15 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-b8143e04-8ad9-45ef-aec2-1eafcc120d45-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-b8143e04-8ad9-45ef-aec2-1eafcc120d45-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-quobyte-b8143e04-8ad9-45ef-aec2-1eafcc120d45" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-b8143e04-8ad9-45ef-aec2-1eafcc120d45" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc9b5eb-9312-41d9-8f11-77af4ee5745c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:15 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 Apr 24 01:21:15 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:16 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a" returned: 0 in 0.682s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:16 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d 1G Apr 24 01:21:16 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:16 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45" returned: 0 in 0.599s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:16 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45 Apr 24 01:21:16 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:16 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d 1G" returned: 0 in 0.692s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b16198-8541-4324-830f-962b32b1a70a -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:16 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b16198-8541-4324-830f-962b32b1a70a -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d Apr 24 01:21:16 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:17 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b8143e04-8ad9-45ef-aec2-1eafcc120d45" returned: 0 in 0.608s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-b8143e04-8ad9-45ef-aec2-1eafcc120d45" released by "delete_volume" :: held 1.252s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Created reservations ['f35a2746-dc31-4b7c-b261-91be960942e6', '146a70cd-67a7-4b3e-9f6a-47f9b39e1e24', '276e7c18-d37d-4ffe-a6e9-7fd045e19869', 'f54a894b-bebf-4d44-a198-61a2a466c986'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:17 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:17 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:17 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b16198-8541-4324-830f-962b32b1a70a -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d" returned: 0 in 0.581s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:17 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d is being set with open permissions: ugo+rw Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:17 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d Apr 24 01:21:17 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:17 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.508s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:17 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Deleted volume successfully. Apr 24 01:21:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0528cfbb-8d30-4ac1-9b87-e29049180673 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-b8143e04-8ad9-45ef-aec2-1eafcc120d45-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:18 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d" returned: 0 in 0.569s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-01a60835-fc01-454b-9de6-3bae33ef0f0e-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-01a60835-fc01-454b-9de6-3bae33ef0f0e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:18 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.info Apr 24 01:21:18 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-quobyte-01a60835-fc01-454b-9de6-3bae33ef0f0e" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-01a60835-fc01-454b-9de6-3bae33ef0f0e" acquired by "delete_volume" :: waited 0.034s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1989f1-cdb8-4484-8196-a53daadf3955]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:18 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e Apr 24 01:21:18 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:18 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.info" returned: 0 in 0.571s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:18 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.info is being set with open permissions: ugo+rw Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:18 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.info Apr 24 01:21:18 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:18 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e" returned: 0 in 0.649s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:18 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e Apr 24 01:21:18 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:19 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.info" returned: 0 in 0.582s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.825s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.054s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Creating offline snapshot de5f96f5-9ce5-4807-ac5a-180b10903546 of volume 902b41d2-ebe0-4bb5-aa59-fb69a649c566 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:21:19 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a9addae7-972f-4816-99d8-90315775a403 tempest-VolumeDependencyTests-1497362426 None] Create snapshot completed successfully Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[571bb0b8-a3b3-4d5e-b4cc-e24a827bb85b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:19 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-01a60835-fc01-454b-9de6-3bae33ef0f0e" returned: 0 in 0.545s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-01a60835-fc01-454b-9de6-3bae33ef0f0e" released by "delete_volume" :: held 1.248s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:19 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 Apr 24 01:21:19 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Created reservations ['fe2cbb21-bab7-4bfd-b5d9-8c4d3bb73b03', 'ad43b583-5242-4b66-9e28-ce60816332cb', '656fd6fc-5980-42c7-afef-fe0f9f07b991', '6fdc379e-7632-4efc-aed8-203904912f80'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:19 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:19 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:20 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566" returned: 0 in 0.727s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:20 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 1G Apr 24 01:21:20 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-ab8f496a-c4de-4a04-a5fc-b3325046f39f-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-ab8f496a-c4de-4a04-a5fc-b3325046f39f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:20 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Flow 'volume_create_manager' (700496f1-2049-47a2-bf04-2461e89149ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a67fad-a4b3-42c2-862b-d0ff390fe642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a67fad-a4b3-42c2-862b-d0ff390fe642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-563172335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68fd18e-59b5-4271-9417-3d94b1e075c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9891af30ffa49b58762b2b313361e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7353ed2-5d8f-407e-b35d-d2e81951212d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:20Z,use_quota=True,user_id='433282e567cf4532b9a642f4e3ed2294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b600aeb7-8c26-4155-9e6f-e9eb4435ebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b600aeb7-8c26-4155-9e6f-e9eb4435ebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72ff7fe-74dc-4565-8b30-5424d82ff257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72ff7fe-74dc-4565-8b30-5424d82ff257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd68fd18e-59b5-4271-9417-3d94b1e075c6', 'volume_name': 'volume-d68fd18e-59b5-4271-9417-3d94b1e075c6', 'volume_size': 1, 'snapshot_id': 'f7353ed2-5d8f-407e-b35d-d2e81951212d'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f8db32-2d10-4278-8311-45ce970e72da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f8db32-2d10-4278-8311-45ce970e72da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efd7c3f-0e7f-456e-9092-a4223e41bd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:20 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Volume d68fd18e-59b5-4271-9417-3d94b1e075c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d68fd18e-59b5-4271-9417-3d94b1e075c6', 'volume_size': 1, 'snapshot_id': 'f7353ed2-5d8f-407e-b35d-d2e81951212d'} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.067s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:20 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Deleted volume successfully. Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-quobyte-ab8f496a-c4de-4a04-a5fc-b3325046f39f" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2f395506-3c8a-4b65-a537-7b6176abe951 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-01a60835-fc01-454b-9de6-3bae33ef0f0e-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-ab8f496a-c4de-4a04-a5fc-b3325046f39f" acquired by "delete_volume" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[90eb2cc9-362d-4403-8dd6-d802ff0dfe79]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:20 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f Apr 24 01:21:20 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:21 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 1G" returned: 0 in 1.034s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:21 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 Apr 24 01:21:21 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:21 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f" returned: 0 in 0.675s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:21 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f Apr 24 01:21:21 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:21 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546" returned: 0 in 0.562s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:21 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 is being set with open permissions: ugo+rw Apr 24 01:21:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:21 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 Apr 24 01:21:21 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:21 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-ab8f496a-c4de-4a04-a5fc-b3325046f39f" returned: 0 in 0.531s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-ab8f496a-c4de-4a04-a5fc-b3325046f39f" released by "delete_volume" :: held 1.252s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Created reservations ['794e0c5a-1345-404c-bd35-d8902a106b1f', '8e7013b5-4322-4b3e-97fb-d82d52839045', '0a9d955f-5a86-4b32-8eff-415f64c7087d', 'aabc9873-0a4a-4474-b2a7-12f75f02f581'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:22 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:22 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:22 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546" returned: 0 in 0.496s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:22 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.info Apr 24 01:21:22 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:22 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.641s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Deleted volume successfully. Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-074e8e4a-935a-4a1d-89ee-614bd4f12e1b tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-ab8f496a-c4de-4a04-a5fc-b3325046f39f-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:22 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.info" returned: 0 in 0.607s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:22 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.info is being set with open permissions: ugo+rw Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:22 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.info Apr 24 01:21:22 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-quobyte-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[216fe211-1e6c-4e15-82a6-43d888fb333d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:22 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 Apr 24 01:21:22 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:23 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.info" returned: 0 in 0.511s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.057s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.675s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-f7353ed2-5d8f-407e-b35d-d2e81951212d-d68fd18e-59b5-4271-9417-3d94b1e075c6" by "_create_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-f7353ed2-5d8f-407e-b35d-d2e81951212d-d68fd18e-59b5-4271-9417-3d94b1e075c6" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Creating volume d68fd18e-59b5-4271-9417-3d94b1e075c6 from snapshot f7353ed2-5d8f-407e-b35d-d2e81951212d {{(pid=81925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-d68fd18e-59b5-4271-9417-3d94b1e075c6" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:23 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-5a6a04b4-e29a-43e1-a7b2-6a42b83f9856 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Create snapshot completed successfully Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-d68fd18e-59b5-4271-9417-3d94b1e075c6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] snapshot: f7353ed2-5d8f-407e-b35d-d2e81951212d, volume: d68fd18e-59b5-4271-9417-3d94b1e075c6, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7b275-6198-4e28-95e6-aa7db4285eeb]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:23 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95" returned: 0 in 0.632s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:23 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95 Apr 24 01:21:23 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:23 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d Apr 24 01:21:23 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Flow 'volume_create_manager' (df02ed57-dea6-4246-b8ec-1cd1f8eed16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1149ef-1f1b-4bdd-970b-70c0899944e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1149ef-1f1b-4bdd-970b-70c0899944e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-554020656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e97c40-1ab3-4260-9e66-8cd23a7f95d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0ba3e149c34a02a73da810d79262a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:24Z,use_quota=True,user_id='b277ab25fe794557b6a3a27e8e503bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c961566-655a-4b86-bb3d-448321c087ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c961566-655a-4b86-bb3d-448321c087ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994802af-a75c-4f18-8496-8b36cc5e37c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994802af-a75c-4f18-8496-8b36cc5e37c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e97c40-1ab3-4260-9e66-8cd23a7f95d3', 'volume_name': 'volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d001d8e8-7145-4c55-bf06-fe89891615f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d001d8e8-7145-4c55-bf06-fe89891615f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9086684e-3703-4283-8df6-fbf19646111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:23 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Volume c3e97c40-1ab3-4260-9e66-8cd23a7f95d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3', 'volume_size': 1} Apr 24 01:21:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (dbc4d818-eb0f-4c79-a345-53c2d5d3606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc232a32-4a1a-422c-a39b-11bd3e54a02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d" returned: 0 in 0.712s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b16198-8541-4324-830f-962b32b1a70a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc232a32-4a1a-422c-a39b-11bd3e54a02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616701532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31c0982-a923-4b9a-9eba-8eb138f13d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:24Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edddbef-d4c9-41b0-80d5-2b7db755b6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edddbef-d4c9-41b0-80d5-2b7db755b6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71daf167-7f16-45db-aaa1-b0ee7e5a822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71daf167-7f16-45db-aaa1-b0ee7e5a822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31c0982-a923-4b9a-9eba-8eb138f13d8b', 'volume_name': 'volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f229766-c7e1-4799-90ff-7eb9df724e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f229766-c7e1-4799-90ff-7eb9df724e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8041e04c-21a5-4ffb-9bb5-1a6aa3def3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume e31c0982-a923-4b9a-9eba-8eb138f13d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b', 'volume_size': 1} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[070b44a7-c170-4fdc-a593-8197d55970e1]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95" returned: 0 in 0.745s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95" released by "delete_volume" :: held 1.430s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:24 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a Apr 24 01:21:24 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Created reservations ['86ff5939-0b69-4028-a609-f0f9716e43bc', '3c9e1460-b639-411f-a482-da5685684ae6', 'f0d94ef1-7b01-46d1-b325-8392070526e6', '3c0f98dc-ab36-4814-a502-4fce9cd3b0bc'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (8f3246dc-307e-40db-a2bd-90921a838082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3414ca3b-cc39-494d-aa90-ae154b36e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3414ca3b-cc39-494d-aa90-ae154b36e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-939823848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:24Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55b758c-4329-4646-a8e2-1da417ea27cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55b758c-4329-4646-a8e2-1da417ea27cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3820e0-c129-4b8f-b68f-ec852b1c4961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3820e0-c129-4b8f-b68f-ec852b1c4961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7', 'volume_name': 'volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21232455-467d-44f5-9cb1-9589895522f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21232455-467d-44f5-9cb1-9589895522f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b85d38-e5ee-4f5f-a45b-0e78be0bef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume 79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7', 'volume_size': 1} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:24 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:24 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (9f3c4223-c1f1-4911-91a8-066cb9575a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47a53df-a15f-4cef-bc7b-4ce0ce4fc439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47a53df-a15f-4cef-bc7b-4ce0ce4fc439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784907910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa8e665-4320-4af6-b97e-656a4bbf3375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:25Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa6e8d5-05c4-400b-ab47-01865375f7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa6e8d5-05c4-400b-ab47-01865375f7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677217b8-57de-42f2-9029-103836c34849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677217b8-57de-42f2-9029-103836c34849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa8e665-4320-4af6-b97e-656a4bbf3375', 'volume_name': 'volume-daa8e665-4320-4af6-b97e-656a4bbf3375', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d13dab-ece1-474e-9ce9-8ed8861a9806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d13dab-ece1-474e-9ce9-8ed8861a9806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcead030-d571-468b-9da5-c6bb1664fbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:24 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume daa8e665-4320-4af6-b97e-656a4bbf3375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa8e665-4320-4af6-b97e-656a4bbf3375', 'volume_size': 1} Apr 24 01:21:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:25 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a" returned: 0 in 0.739s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:25 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 Apr 24 01:21:25 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (ae3fabbf-8f3a-49d7-8351-345004458307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e97d40-d8c8-4636-b0f8-668f14351b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-e099f3a3-489c-40af-ad52-5fb717772bdb-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-e099f3a3-489c-40af-ad52-5fb717772bdb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:25 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e97d40-d8c8-4636-b0f8-668f14351b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144227001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b933fa06-5d98-4a7c-9692-fdabff6265e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:25Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e533b579-e8fe-4e84-ae5f-9cd8cc67dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e533b579-e8fe-4e84-ae5f-9cd8cc67dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd0099e-34fb-464f-ac04-f0f4debcf424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd0099e-34fb-464f-ac04-f0f4debcf424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b933fa06-5d98-4a7c-9692-fdabff6265e1', 'volume_name': 'volume-b933fa06-5d98-4a7c-9692-fdabff6265e1', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (decc5729-a454-42cf-b166-7468b3e538ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (decc5729-a454-42cf-b166-7468b3e538ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f5b4e5-b629-468a-a4f6-5039cc60ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume b933fa06-5d98-4a7c-9692-fdabff6265e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b933fa06-5d98-4a7c-9692-fdabff6265e1', 'volume_size': 1} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.713s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:25 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Deleted volume successfully. Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "cinder-quobyte-e099f3a3-489c-40af-ad52-5fb717772bdb" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-568de12b-4c01-4780-a075-cc7845dc1831 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-0c3e789b-e5e4-4b34-b2a6-da5f96a5de95-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-e099f3a3-489c-40af-ad52-5fb717772bdb" acquired by "delete_volume" :: waited 0.037s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[86018858-c7a0-4bb0-a84e-e672a22031d5]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:25 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb Apr 24 01:21:25 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (10ef33c9-23f4-416c-a3bc-96e305519fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62cae5b-3c15-498c-bfca-73259b200814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62cae5b-3c15-498c-bfca-73259b200814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304233952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39883204-a1b4-4af1-8d66-0ad4d5303610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:25Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e24c6b-1ad7-4f4e-9af2-b1ea713f0c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e24c6b-1ad7-4f4e-9af2-b1ea713f0c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27067364-a7d0-4e33-8346-941700202f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27067364-a7d0-4e33-8346-941700202f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39883204-a1b4-4af1-8d66-0ad4d5303610', 'volume_name': 'volume-39883204-a1b4-4af1-8d66-0ad4d5303610', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ff659-7152-403b-9a07-3785b65f6e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ff659-7152-403b-9a07-3785b65f6e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603907fc-25df-47e1-baac-4417657ccde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:25 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume 39883204-a1b4-4af1-8d66-0ad4d5303610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39883204-a1b4-4af1-8d66-0ad4d5303610', 'volume_size': 1} Apr 24 01:21:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:26 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb" returned: 0 in 0.687s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:26 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb Apr 24 01:21:26 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:26 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e099f3a3-489c-40af-ad52-5fb717772bdb" returned: 0 in 0.790s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-quobyte-e099f3a3-489c-40af-ad52-5fb717772bdb" released by "delete_volume" :: held 1.550s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:27 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Created reservations ['e28eeebc-575d-407c-a286-227a77c0d1c4', 'f8412827-5d2a-4ef3-8d9b-aa64e9abb056', 'b92917c4-d4e7-44c4-8ba5-c2d25acb834c', 'd36c7d9f-84b9-4962-bc82-8ab4702a2ff6'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:27 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:27 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:27 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:28 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.044s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:28 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Deleted volume successfully. Apr 24 01:21:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0665a930-80e4-44e1-bfb8-ddf1df868475 tempest-CreateVolumesFromImageTest-1269884142 None] Lock "cinder-e099f3a3-489c-40af-ad52-5fb717772bdb-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:30 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6" returned: 0 in 5.636s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:30 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d53108-7299-4670-9d84-4ddbb49381d1]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:30 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a Apr 24 01:21:30 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:31 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a" returned: 0 in 0.698s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:21:31 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Converted 1024.00 MB image at 181.65 MB/s Apr 24 01:21:31 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 is being set with open permissions: ugo+rw Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:31 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 Apr 24 01:21:31 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:31 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6" returned: 0 in 0.497s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-d68fd18e-59b5-4271-9417-3d94b1e075c6" released by "_copy_volume_from_snapshot" :: held 8.471s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-f7353ed2-5d8f-407e-b35d-d2e81951212d-d68fd18e-59b5-4271-9417-3d94b1e075c6" released by "_create_volume_from_snapshot" :: held 8.512s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.551s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.897s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-554020656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e97c40-1ab3-4260-9e66-8cd23a7f95d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0ba3e149c34a02a73da810d79262a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:24Z,use_quota=True,user_id='b277ab25fe794557b6a3a27e8e503bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Creating volume c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:31 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:31 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 1073741824 Apr 24 01:21:31 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efd7c3f-0e7f-456e-9092-a4223e41bd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68fd18e-59b5-4271-9417-3d94b1e075c6', 'volume_size': 1, 'snapshot_id': 'f7353ed2-5d8f-407e-b35d-d2e81951212d'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504dd544-7917-48e6-83b7-c97ff9af9f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (a4c80be5-c8a9-4bec-ba59-6f03c4e07162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:31 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4da886-f986-4859-a922-f6459284a711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4da886-f986-4859-a922-f6459284a711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1705245105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f0860e-58d9-45c2-8a52-f00c4442b79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:32Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8f1300-832b-4fdf-a1ab-b9782dadf1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8f1300-832b-4fdf-a1ab-b9782dadf1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6116d551-fb66-4146-b019-cb98dfeafd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6116d551-fb66-4146-b019-cb98dfeafd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f0860e-58d9-45c2-8a52-f00c4442b79f', 'volume_name': 'volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5aab83-153a-4a14-aa9c-9f7524cb604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5aab83-153a-4a14-aa9c-9f7524cb604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d2bb9d-1aa2-41b6-a1a0-10a86749293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:32 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume a5f0860e-58d9-45c2-8a52-f00c4442b79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f', 'volume_size': 1} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:32 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Volume volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 (d68fd18e-59b5-4271-9417-3d94b1e075c6): created successfully Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504dd544-7917-48e6-83b7-c97ff9af9f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Flow 'volume_create_manager' (700496f1-2049-47a2-bf04-2461e89149ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:32 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b0c598af-8eec-4fae-b408-333727a671aa tempest-VolumeDependencyTests-1497362426 None] Created volume successfully. Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-f7353ed2-5d8f-407e-b35d-d2e81951212d-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-f7353ed2-5d8f-407e-b35d-d2e81951212d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-79b16198-8541-4324-830f-962b32b1a70a" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-79b16198-8541-4324-830f-962b32b1a70a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-f7353ed2-5d8f-407e-b35d-d2e81951212d" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-f7353ed2-5d8f-407e-b35d-d2e81951212d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Deleting offline snapshot f7353ed2-5d8f-407e-b35d-d2e81951212d of volume 79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] snapshot_file for this snap is: volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4059696-531d-4d62-a867-ae7f34070f24]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:32 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d Apr 24 01:21:32 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:32 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 1073741824" returned: 0 in 0.652s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:32 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:32 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 Apr 24 01:21:32 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:33 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d" returned: 0 in 0.563s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b16198-8541-4324-830f-962b32b1a70a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffaea58-4ea2-41a4-80dd-2833c5c1426b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:33 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" returned: 0 in 0.461s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.800s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616701532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31c0982-a923-4b9a-9eba-8eb138f13d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:24Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Creating volume e31c0982-a923-4b9a-9eba-8eb138f13d8b {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:33 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9086684e-3703-4283-8df6-fbf19646111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1b832e-9cab-4e2b-8c07-9e08fafb22a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:33 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b 1073741824 Apr 24 01:21:33 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:33 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Volume volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 (c3e97c40-1ab3-4260-9e66-8cd23a7f95d3): created successfully Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1b832e-9cab-4e2b-8c07-9e08fafb22a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Flow 'volume_create_manager' (df02ed57-dea6-4246-b8ec-1cd1f8eed16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:33 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c04b0ba5-be8d-4bc5-9264-ed63f6a269ff tempest-SnapshotDependencyTests-2093157742 None] Created volume successfully. Apr 24 01:21:33 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a Apr 24 01:21:33 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:33 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a" returned: 0 in 0.575s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:33 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d Apr 24 01:21:33 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:33 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b 1073741824" returned: 0 in 0.631s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:33 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:33 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b Apr 24 01:21:33 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:34 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d" returned: 0 in 0.656s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:34 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b" returned: 0 in 0.538s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.803s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-939823848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:24Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Creating volume 79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:34 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d Apr 24 01:21:34 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:34 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8041e04c-21a5-4ffb-9bb5-1a6aa3def3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:34 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 1073741824 Apr 24 01:21:34 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8530b45d-9940-4f14-b0bd-0488d5470dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:34 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b (e31c0982-a923-4b9a-9eba-8eb138f13d8b): created successfully Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8530b45d-9940-4f14-b0bd-0488d5470dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (dbc4d818-eb0f-4c79-a345-53c2d5d3606a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:34 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-758185f1-ce26-4869-ab8f-14945d4c98c4 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created volume successfully. Apr 24 01:21:34 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a.f7353ed2-5d8f-407e-b35d-d2e81951212d" returned: 0 in 0.508s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-f7353ed2-5d8f-407e-b35d-d2e81951212d" released by "_delete_snapshot" :: held 2.399s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-79b16198-8541-4324-830f-962b32b1a70a" released by "delete_snapshot" :: held 2.424s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Created reservations ['c1799e7e-6093-4acf-86da-6b5123154ba5', 'd86db1cd-cdc3-4aad-b9e9-93f2ebcfe328', 'ea1fa11e-9942-439e-9698-ff7e724354dc', 'c771aef2-fad7-4b4b-92e8-99979025c203'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:34 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Delete snapshot completed successfully. Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a7d04f00-2d02-4b6d-84bd-2a837e6a89c0 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-f7353ed2-5d8f-407e-b35d-d2e81951212d-delete_snapshot" released by "delete_snapshot" :: held 2.571s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:34 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 1073741824" returned: 0 in 0.656s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:34 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:35 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 Apr 24 01:21:35 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:35 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7" returned: 0 in 0.469s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.574s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784907910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa8e665-4320-4af6-b97e-656a4bbf3375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:25Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Creating volume daa8e665-4320-4af6-b97e-656a4bbf3375 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:35 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b85d38-e5ee-4f5f-a45b-0e78be0bef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c93e8f-5911-4a1d-830f-79896a76f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:35 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 1073741824 Apr 24 01:21:35 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:35 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 (79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7): created successfully Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c93e8f-5911-4a1d-830f-79896a76f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (8f3246dc-307e-40db-a2bd-90921a838082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-79b16198-8541-4324-830f-962b32b1a70a-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:35 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-201568b7-a94c-40de-93b5-1a4308cca737 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created volume successfully. Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-79b16198-8541-4324-830f-962b32b1a70a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-79b16198-8541-4324-830f-962b32b1a70a" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-79b16198-8541-4324-830f-962b32b1a70a" acquired by "delete_volume" :: waited 0.013s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b348ad7-2de8-4f97-b6aa-855e60b67e2c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:35 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:35 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a Apr 24 01:21:35 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:36 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 1073741824" returned: 0 in 0.615s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:36 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 Apr 24 01:21:36 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:36 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a" returned: 0 in 0.540s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:36 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a Apr 24 01:21:36 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:36 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375" returned: 0 in 0.428s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.331s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144227001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b933fa06-5d98-4a7c-9692-fdabff6265e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:25Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Creating volume b933fa06-5d98-4a7c-9692-fdabff6265e1 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:36 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcead030-d571-468b-9da5-c6bb1664fbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa8e665-4320-4af6-b97e-656a4bbf3375', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331d0f0a-1e49-43f1-9f29-450214689a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:36 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 1073741824 Apr 24 01:21:36 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:36 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume volume-daa8e665-4320-4af6-b97e-656a4bbf3375 (daa8e665-4320-4af6-b97e-656a4bbf3375): created successfully Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331d0f0a-1e49-43f1-9f29-450214689a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (9f3c4223-c1f1-4911-91a8-066cb9575a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:36 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-8655d576-97ac-4b91-8410-f342b268aeb8 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created volume successfully. Apr 24 01:21:36 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79b16198-8541-4324-830f-962b32b1a70a" returned: 0 in 0.494s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-79b16198-8541-4324-830f-962b32b1a70a" released by "delete_volume" :: held 1.089s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Created reservations ['ac7196a5-a8ca-47ce-afe3-2e40fc57721e', '91929e6b-e0be-4bb7-8698-a8f0aea53d11', '7ed1092b-66e7-41e0-8673-5d4c1f341616', '944af17a-b823-4883-8e25-05d315c53cb0'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:36 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:36 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:36 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:37 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 1073741824" returned: 0 in 0.702s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:37 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.493s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:37 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Deleted volume successfully. Apr 24 01:21:37 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 Apr 24 01:21:37 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d46e85c9-a256-4ad3-b1a4-c75d32195256 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-79b16198-8541-4324-830f-962b32b1a70a-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:37 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1" returned: 0 in 0.452s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.228s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304233952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39883204-a1b4-4af1-8d66-0ad4d5303610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb11a4e51437f921888926864e09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:25Z,use_quota=True,user_id='9e2a385640ba4719873b632e2f716557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Creating volume 39883204-a1b4-4af1-8d66-0ad4d5303610 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:37 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:37 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 1073741824 Apr 24 01:21:37 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f5b4e5-b629-468a-a4f6-5039cc60ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b933fa06-5d98-4a7c-9692-fdabff6265e1', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e167616a-750c-45d6-a68e-564b6ce19154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:37 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 (b933fa06-5d98-4a7c-9692-fdabff6265e1): created successfully Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e167616a-750c-45d6-a68e-564b6ce19154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:37 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (ae3fabbf-8f3a-49d7-8351-345004458307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:37 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-68bcadd9-86f7-4a28-a2c9-b102e02237bf tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created volume successfully. Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Flow 'volume_create_manager' (180460cf-9192-425c-9ab0-dd068f61f3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aeead26-3555-42c6-bd5c-d32a6fa580e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aeead26-3555-42c6-bd5c-d32a6fa580e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1329654038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019732bf-7692-4e2f-b684-dab769edce66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9891af30ffa49b58762b2b313361e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:38Z,use_quota=True,user_id='433282e567cf4532b9a642f4e3ed2294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b49b387-26b9-4072-9404-d9ae0f44daba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b49b387-26b9-4072-9404-d9ae0f44daba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35287546-c29b-4f71-befc-d76148aa689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35287546-c29b-4f71-befc-d76148aa689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '019732bf-7692-4e2f-b684-dab769edce66', 'volume_name': 'volume-019732bf-7692-4e2f-b684-dab769edce66', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901e40ab-59dc-41b3-a4b3-df26d2dedf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901e40ab-59dc-41b3-a4b3-df26d2dedf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb54e45e-2a6a-4b32-ac1c-b4d2dec816ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:38 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Volume 019732bf-7692-4e2f-b684-dab769edce66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-019732bf-7692-4e2f-b684-dab769edce66', 'volume_size': 1} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:38 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 1073741824" returned: 0 in 0.625s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:38 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 Apr 24 01:21:38 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:38 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610" returned: 0 in 0.435s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.836s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1705245105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f0860e-58d9-45c2-8a52-f00c4442b79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:32Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Creating volume a5f0860e-58d9-45c2-8a52-f00c4442b79f {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:38 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603907fc-25df-47e1-baac-4417657ccde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39883204-a1b4-4af1-8d66-0ad4d5303610', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:38 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f 1073741824 Apr 24 01:21:38 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf215d22-43ff-46c9-8b08-e37cb8f1cd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:38 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Volume volume-39883204-a1b4-4af1-8d66-0ad4d5303610 (39883204-a1b4-4af1-8d66-0ad4d5303610): created successfully Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf215d22-43ff-46c9-8b08-e37cb8f1cd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:38 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Flow 'volume_create_manager' (10ef33c9-23f4-416c-a3bc-96e305519fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:38 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0e009a15-d71f-4235-9c31-2d15be3a2d37 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created volume successfully. Apr 24 01:21:39 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f 1073741824" returned: 0 in 0.596s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:39 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f Apr 24 01:21:39 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-39883204-a1b4-4af1-8d66-0ad4d5303610-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-39883204-a1b4-4af1-8d66-0ad4d5303610-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-quobyte-39883204-a1b4-4af1-8d66-0ad4d5303610" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-39883204-a1b4-4af1-8d66-0ad4d5303610" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2230e63-c623-4d61-ab5d-eeb4b4170ecb]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:39 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 Apr 24 01:21:39 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:39 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f" returned: 0 in 0.467s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.975s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d2bb9d-1aa2-41b6-a1a0-10a86749293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:39 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93572cb-7747-45cf-b3c6-8ecb8965b283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:40 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f (a5f0860e-58d9-45c2-8a52-f00c4442b79f): created successfully Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93572cb-7747-45cf-b3c6-8ecb8965b283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (a4c80be5-c8a9-4bec-ba59-6f03c4e07162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Creating offline snapshot a6865617-711b-4eac-9dcd-ea0bb47b89f5 of volume c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:21:40 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e8aebfea-2118-4705-98ea-0ecb9428c032 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created volume successfully. Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16dd5b-e6fb-48d5-a01b-50eb1663aae2]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:40 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 Apr 24 01:21:40 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:40 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610" returned: 0 in 0.558s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:40 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610 Apr 24 01:21:40 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:40 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" returned: 0 in 0.573s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:40 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 1G Apr 24 01:21:40 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (a92dfe80-ac1f-4669-8202-01d15d337dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbfe711-7331-4d14-8a0c-b655cc1599d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbfe711-7331-4d14-8a0c-b655cc1599d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1189537325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6cc8cd-af72-47ea-8856-b1d177eca4b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:41Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46c82de-dd33-4340-8c76-14377cff982a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46c82de-dd33-4340-8c76-14377cff982a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613046d8-7aa4-40f2-b842-e98b0f58ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613046d8-7aa4-40f2-b842-e98b0f58ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6cc8cd-af72-47ea-8856-b1d177eca4b9', 'volume_name': 'volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1812a74f-d835-4736-96f0-b7866a4ede09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1812a74f-d835-4736-96f0-b7866a4ede09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda5903f-4632-40b1-a6c6-494ecadf7b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:40 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume 8b6cc8cd-af72-47ea-8856-b1d177eca4b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9', 'volume_size': 1} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:40 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-39883204-a1b4-4af1-8d66-0ad4d5303610" returned: 0 in 0.525s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-39883204-a1b4-4af1-8d66-0ad4d5303610" released by "delete_volume" :: held 1.126s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:40 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created reservations ['26f535f0-88fb-470b-9a6f-3c2e6791ac39', '693d6af0-9795-46a7-b956-5a3493cb5443', '562a7430-223e-45fc-abe6-68fc0f15b332', '92716f01-b8a7-4efe-8e2e-4d71d3ef30f0'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:41 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:41 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (7ead5376-c405-45d7-b312-ac751d5054cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f966e5-2b07-473c-beac-3a7851294862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f966e5-2b07-473c-beac-3a7851294862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-454383107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9257898-f30f-4352-838d-8710b0ba0f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:41Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24f08aa-ebcb-419b-ba16-092e2a92543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24f08aa-ebcb-419b-ba16-092e2a92543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b61dcdd-a766-4f7d-a7b6-50c9fe851d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b61dcdd-a766-4f7d-a7b6-50c9fe851d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9257898-f30f-4352-838d-8710b0ba0f56', 'volume_name': 'volume-f9257898-f30f-4352-838d-8710b0ba0f56', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719f3369-c278-4854-8337-215c7b2d3f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719f3369-c278-4854-8337-215c7b2d3f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecba42b0-a0f2-4269-8a20-f067ee7024a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume f9257898-f30f-4352-838d-8710b0ba0f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9257898-f30f-4352-838d-8710b0ba0f56', 'volume_size': 1} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (a9f80bf8-2d94-4288-b14e-dd055740d571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15dbb47-d233-419a-9a41-620fa61bb73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15dbb47-d233-419a-9a41-620fa61bb73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517061532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee56cf6-b72b-485b-bc61-df633cf99a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:41Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9d8bf8-418f-4b75-9f08-7aa2cdc84285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9d8bf8-418f-4b75-9f08-7aa2cdc84285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809ddc9a-1c29-41dc-9c30-da2582147cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809ddc9a-1c29-41dc-9c30-da2582147cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee56cf6-b72b-485b-bc61-df633cf99a01', 'volume_name': 'volume-3ee56cf6-b72b-485b-bc61-df633cf99a01', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56403e0-9a99-4edb-b45b-37cd5610ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56403e0-9a99-4edb-b45b-37cd5610ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4871958c-854c-4f43-b21e-bc4652e11e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume 3ee56cf6-b72b-485b-bc61-df633cf99a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee56cf6-b72b-485b-bc61-df633cf99a01', 'volume_size': 1} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:41 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 1G" returned: 0 in 0.886s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:41 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 Apr 24 01:21:41 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (312c07b2-c633-48dc-9a92-f3f3c0c78cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2fa329-06e5-456b-9e75-fe7b8a89316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2fa329-06e5-456b-9e75-fe7b8a89316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-462000076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b5bc92-022b-42dd-afa3-188cab7a804f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:42Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a690d0be-89d6-4d6c-9145-963ea63163b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a690d0be-89d6-4d6c-9145-963ea63163b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ca5b83-76ff-4e29-b22e-7ec2f839efb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ca5b83-76ff-4e29-b22e-7ec2f839efb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b5bc92-022b-42dd-afa3-188cab7a804f', 'volume_name': 'volume-67b5bc92-022b-42dd-afa3-188cab7a804f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad8bced-6cec-42f2-a48a-c4e14327de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad8bced-6cec-42f2-a48a-c4e14327de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c1ff0d-b51d-44cb-ae7e-d2006f0c62ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume 67b5bc92-022b-42dd-afa3-188cab7a804f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b5bc92-022b-42dd-afa3-188cab7a804f', 'volume_size': 1} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:41 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.669s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:41 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Deleted volume successfully. Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ac414666-7029-4098-aba1-93328db8868e tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-39883204-a1b4-4af1-8d66-0ad4d5303610-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (e386ee27-995b-40fc-b07a-02202a1faeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b7f6a3-688e-46c9-8f8e-fe047f0377b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b7f6a3-688e-46c9-8f8e-fe047f0377b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-140241101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7f0b73-36f0-435e-a257-0e3884270fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:42Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bb5acf-cf62-4afd-a3e3-b73f52eaf9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bb5acf-cf62-4afd-a3e3-b73f52eaf9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fc8b21-5ca8-43da-a81f-3ffe980e78f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fc8b21-5ca8-43da-a81f-3ffe980e78f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7f0b73-36f0-435e-a257-0e3884270fce', 'volume_name': 'volume-af7f0b73-36f0-435e-a257-0e3884270fce', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941bc06a-8093-4224-be4f-3c64de722a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941bc06a-8093-4224-be4f-3c64de722a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135ae6f3-c744-4503-8024-598b06586282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:41 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume af7f0b73-36f0-435e-a257-0e3884270fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7f0b73-36f0-435e-a257-0e3884270fce', 'volume_size': 1} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-b933fa06-5d98-4a7c-9692-fdabff6265e1-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:41 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-b933fa06-5d98-4a7c-9692-fdabff6265e1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-quobyte-b933fa06-5d98-4a7c-9692-fdabff6265e1" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-b933fa06-5d98-4a7c-9692-fdabff6265e1" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[68becb4c-7853-42af-b03f-70b3c283d9f6]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:42 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5" returned: 0 in 0.614s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:42 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 is being set with open permissions: ugo+rw Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:42 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 Apr 24 01:21:42 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:42 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 Apr 24 01:21:42 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:42 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5" returned: 0 in 0.476s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:42 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1" returned: 0 in 0.567s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:42 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:42 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1 Apr 24 01:21:42 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:42 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.info Apr 24 01:21:42 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:43 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.info" returned: 0 in 0.438s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:43 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.info is being set with open permissions: ugo+rw Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:43 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-b933fa06-5d98-4a7c-9692-fdabff6265e1" returned: 0 in 0.462s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-b933fa06-5d98-4a7c-9692-fdabff6265e1" released by "delete_volume" :: held 1.075s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:43 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.info Apr 24 01:21:43 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created reservations ['ea4be1e1-3fd1-4f78-bff3-3ac9afc0039b', 'e7b4cc3b-3cfd-4116-8136-b8fe8778e637', '5534ee05-a954-4419-97a8-311eef173b37', '006def21-aba5-44c4-a541-27e0bb410d11'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:43 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:43 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:43 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.info" returned: 0 in 0.465s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.586s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.408s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1329654038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019732bf-7692-4e2f-b684-dab769edce66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9891af30ffa49b58762b2b313361e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:38Z,use_quota=True,user_id='433282e567cf4532b9a642f4e3ed2294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Creating volume 019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:43 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:43 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 1073741824 Apr 24 01:21:43 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:43 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-973ea1dd-3d7b-4d4e-8e93-64a227ab37de tempest-SnapshotDependencyTests-2093157742 None] Create snapshot completed successfully Apr 24 01:21:43 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.468s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:43 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Deleted volume successfully. Apr 24 01:21:43 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a21fd86f-dde2-4f6a-96b6-b7e3b4de1053 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-b933fa06-5d98-4a7c-9692-fdabff6265e1-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:44 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-daa8e665-4320-4af6-b97e-656a4bbf3375-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 1073741824" returned: 0 in 0.630s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-daa8e665-4320-4af6-b97e-656a4bbf3375-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:44 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 Apr 24 01:21:44 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-quobyte-daa8e665-4320-4af6-b97e-656a4bbf3375" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-daa8e665-4320-4af6-b97e-656a4bbf3375" acquired by "delete_volume" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[565db858-9259-4fc7-a2d2-6d3ade83c19a]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:44 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 Apr 24 01:21:44 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:44 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66" returned: 0 in 0.533s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.945s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1189537325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6cc8cd-af72-47ea-8856-b1d177eca4b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:41Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Creating volume 8b6cc8cd-af72-47ea-8856-b1d177eca4b9 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:44 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb54e45e-2a6a-4b32-ac1c-b4d2dec816ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019732bf-7692-4e2f-b684-dab769edce66', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:44 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 1073741824 Apr 24 01:21:44 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdc274d-7106-47e9-bb50-3245c285af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:44 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Volume volume-019732bf-7692-4e2f-b684-dab769edce66 (019732bf-7692-4e2f-b684-dab769edce66): created successfully Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdc274d-7106-47e9-bb50-3245c285af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Flow 'volume_create_manager' (180460cf-9192-425c-9ab0-dd068f61f3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:44 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-f7799f01-b376-4972-877a-d56d46cb6c10 tempest-VolumeDependencyTests-1497362426 None] Created volume successfully. Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Flow 'volume_create_manager' (06d4ebf2-ef98-44fd-a076-de381abc6578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf5c07a-b655-448d-968a-7de6f3cbab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf5c07a-b655-448d-968a-7de6f3cbab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1d4eb0-f27d-4db2-8ac8-f295803f607d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0ba3e149c34a02a73da810d79262a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6865617-711b-4eac-9dcd-ea0bb47b89f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:45Z,use_quota=True,user_id='b277ab25fe794557b6a3a27e8e503bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2f3460-95f1-44b2-99b0-83553153a7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2f3460-95f1-44b2-99b0-83553153a7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291fabca-8911-4b6b-845b-7f8e52da433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291fabca-8911-4b6b-845b-7f8e52da433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d1d4eb0-f27d-4db2-8ac8-f295803f607d', 'volume_name': 'volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d', 'volume_size': 1, 'snapshot_id': 'a6865617-711b-4eac-9dcd-ea0bb47b89f5'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fed8c1-9ac8-432e-84a6-7d4be3e84399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:44 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fed8c1-9ac8-432e-84a6-7d4be3e84399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:44 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699d55df-e36f-402f-b6ee-571a3c539cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:44 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Volume 8d1d4eb0-f27d-4db2-8ac8-f295803f607d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d', 'volume_size': 1, 'snapshot_id': 'a6865617-711b-4eac-9dcd-ea0bb47b89f5'} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375" returned: 0 in 0.647s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:45 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375 Apr 24 01:21:45 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:45 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-daa8e665-4320-4af6-b97e-656a4bbf3375" returned: 0 in 0.481s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-daa8e665-4320-4af6-b97e-656a4bbf3375" released by "delete_volume" :: held 1.177s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:45 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 1073741824" returned: 0 in 0.722s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created reservations ['26225f25-116e-41c8-8862-6014e933442a', '804e80c4-6943-45ff-9e87-c7db7e2ee972', 'c96d4c53-c319-4e07-a2f6-dec2d6c7234a', '46a73f52-9623-47b8-ab54-41eb2e58a36f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:45 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 Apr 24 01:21:45 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:45 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:45 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Flow 'volume_create_manager' (9752cc3d-3eb5-4b7b-af80-325c10eabf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:45 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb477686-c972-45ae-ada5-e232bdac0704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb477686-c972-45ae-ada5-e232bdac0704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1120176251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c943347f-d376-487a-b92d-42989a1916c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9891af30ffa49b58762b2b313361e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=019732bf-7692-4e2f-b684-dab769edce66,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:46Z,use_quota=True,user_id='433282e567cf4532b9a642f4e3ed2294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d4f2ca-5d70-40a7-a86a-26641117c55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d4f2ca-5d70-40a7-a86a-26641117c55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c89057-5051-4724-aeaf-e3e97e12fc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c89057-5051-4724-aeaf-e3e97e12fc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c943347f-d376-487a-b92d-42989a1916c3', 'volume_name': 'volume-c943347f-d376-487a-b92d-42989a1916c3', 'volume_size': 1, 'source_volid': '019732bf-7692-4e2f-b684-dab769edce66', 'source_volstatus': 'available'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08b24ed-0f3e-46f4-b93d-0a87ff7b12b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08b24ed-0f3e-46f4-b93d-0a87ff7b12b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b39607-4f42-4ed0-8207-684229fd1f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:46 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Volume c943347f-d376-487a-b92d-42989a1916c3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c943347f-d376-487a-b92d-42989a1916c3', 'volume_size': 1, 'source_volid': '019732bf-7692-4e2f-b684-dab769edce66', 'source_volstatus': 'available'} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:46 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9" returned: 0 in 0.503s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.886s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-454383107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9257898-f30f-4352-838d-8710b0ba0f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:41Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Creating volume f9257898-f30f-4352-838d-8710b0ba0f56 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:46 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda5903f-4632-40b1-a6c6-494ecadf7b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:46 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 1073741824 Apr 24 01:21:46 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9f9ab3-f6fd-44a3-b6e0-cdd5ec006837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:46 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 (8b6cc8cd-af72-47ea-8856-b1d177eca4b9): created successfully Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9f9ab3-f6fd-44a3-b6e0-cdd5ec006837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (a92dfe80-ac1f-4669-8202-01d15d337dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:46 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:46 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-c1a76895-b046-474c-9599-357bc934e37a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created volume successfully. Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.517s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:46 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Deleted volume successfully. Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d98c0b79-2018-446d-9de8-fdc683a9e755 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-daa8e665-4320-4af6-b97e-656a4bbf3375-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-quobyte-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[408ea8b3-774e-427c-a4fc-f8aaefc6b15e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:46 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 Apr 24 01:21:46 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:46 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 1073741824" returned: 0 in 0.620s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:46 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:46 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 Apr 24 01:21:46 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:47 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7" returned: 0 in 0.548s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:47 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7 Apr 24 01:21:47 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:47 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56" returned: 0 in 0.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.817s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517061532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee56cf6-b72b-485b-bc61-df633cf99a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:41Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Creating volume 3ee56cf6-b72b-485b-bc61-df633cf99a01 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:47 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:47 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 1073741824 Apr 24 01:21:47 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecba42b0-a0f2-4269-8a20-f067ee7024a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9257898-f30f-4352-838d-8710b0ba0f56', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eef23f0-e2a7-4ff6-b4f9-089bcc842ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:47 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume volume-f9257898-f30f-4352-838d-8710b0ba0f56 (f9257898-f30f-4352-838d-8710b0ba0f56): created successfully Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eef23f0-e2a7-4ff6-b4f9-089bcc842ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (7ead5376-c405-45d7-b312-ac751d5054cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:47 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-48c2203a-47c0-4eec-bcd9-ee0f4a0f1ab4 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created volume successfully. Apr 24 01:21:47 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7" returned: 0 in 0.451s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7" released by "delete_volume" :: held 1.038s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created reservations ['9c664a57-b1e2-487e-bf11-ee6cacc5ee3f', 'cc983396-34e8-486a-a177-d5b165359108', '2f4452b2-fb25-4709-9cf0-85cf82bab549', 'e832eb75-c4be-446f-883a-e4b40ac9acc3'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:47 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:47 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:47 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 1073741824" returned: 0 in 0.609s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:47 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:47 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 Apr 24 01:21:47 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:48 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.469s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Deleted volume successfully. Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9c1ea19d-7d91-4117-bfbd-24c22a16c736 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-79c3cd16-06ee-49d6-bfa0-c2726cd5a5e7-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:48 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01" returned: 0 in 0.491s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.721s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-462000076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b5bc92-022b-42dd-afa3-188cab7a804f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:42Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Creating volume 67b5bc92-022b-42dd-afa3-188cab7a804f {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:48 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4871958c-854c-4f43-b21e-bc4652e11e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee56cf6-b72b-485b-bc61-df633cf99a01', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:48 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f 1073741824 Apr 24 01:21:48 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb5f24e-5094-43ef-bad5-215b45b756f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:48 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 (3ee56cf6-b72b-485b-bc61-df633cf99a01): created successfully Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb5f24e-5094-43ef-bad5-215b45b756f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (a9f80bf8-2d94-4288-b14e-dd055740d571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:48 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a32493a2-97a8-40ef-906a-ecb939da23ec tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created volume successfully. Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-e31c0982-a923-4b9a-9eba-8eb138f13d8b-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-e31c0982-a923-4b9a-9eba-8eb138f13d8b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-quobyte-e31c0982-a923-4b9a-9eba-8eb138f13d8b" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-e31c0982-a923-4b9a-9eba-8eb138f13d8b" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfb33ec-1255-4a3c-aadf-3b9676c0808f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:48 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:48 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b Apr 24 01:21:48 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:49 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f 1073741824" returned: 0 in 0.705s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:49 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f Apr 24 01:21:49 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:49 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b" returned: 0 in 0.583s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:49 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b Apr 24 01:21:49 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:49 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f" returned: 0 in 0.486s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.698s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-140241101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7f0b73-36f0-435e-a257-0e3884270fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fce9f6809564dbfa26adced481c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:21:42Z,use_quota=True,user_id='5e86674a81134b11a126e0d8470ffb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Creating volume af7f0b73-36f0-435e-a257-0e3884270fce {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:49 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:49 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce 1073741824 Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c1ff0d-b51d-44cb-ae7e-d2006f0c62ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b5bc92-022b-42dd-afa3-188cab7a804f', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:49 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389dc5fb-b3f7-4e61-89a3-02dcbcee6946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:49 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume volume-67b5bc92-022b-42dd-afa3-188cab7a804f (67b5bc92-022b-42dd-afa3-188cab7a804f): created successfully Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389dc5fb-b3f7-4e61-89a3-02dcbcee6946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (312c07b2-c633-48dc-9a92-f3f3c0c78cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:49 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0afca919-d82a-4e1a-8b01-bb47ed3fd7c6 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created volume successfully. Apr 24 01:21:49 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e31c0982-a923-4b9a-9eba-8eb138f13d8b" returned: 0 in 0.463s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-e31c0982-a923-4b9a-9eba-8eb138f13d8b" released by "delete_volume" :: held 1.083s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:49 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created reservations ['599208e5-7087-477a-a816-db0a5c4c3e16', '98c522f1-6fe1-4e65-81f3-a4631c00c94f', 'fed5acc8-ff9d-414c-9a6e-efeec19d80f9', 'fa5fa499-7e0b-4f79-831d-913f0485bed5'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:50 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:50 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:50 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce 1073741824" returned: 0 in 0.672s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:50 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce Apr 24 01:21:50 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:50 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.517s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:50 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Deleted volume successfully. Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-ef59fbce-03d6-44d1-a367-b15d8ee6f264 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-e31c0982-a923-4b9a-9eba-8eb138f13d8b-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:50 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce" returned: 0 in 0.502s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.856s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-quobyte-a6865617-711b-4eac-9dcd-ea0bb47b89f5-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" by "_create_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-de5f96f5-9ce5-4807-ac5a-180b10903546-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135ae6f3-c744-4503-8024-598b06586282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7f0b73-36f0-435e-a257-0e3884270fce', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454f0941-99f1-42f7-9946-3c8751f4c869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-a6865617-711b-4eac-9dcd-ea0bb47b89f5-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Creating volume 8d1d4eb0-f27d-4db2-8ac8-f295803f607d from snapshot a6865617-711b-4eac-9dcd-ea0bb47b89f5 {{(pid=81925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-quobyte-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:50 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Volume volume-af7f0b73-36f0-435e-a257-0e3884270fce (af7f0b73-36f0-435e-a257-0e3884270fce): created successfully Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454f0941-99f1-42f7-9946-3c8751f4c869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Flow 'volume_create_manager' (e386ee27-995b-40fc-b07a-02202a1faeb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] snapshot: a6865617-711b-4eac-9dcd-ea0bb47b89f5, volume: 8d1d4eb0-f27d-4db2-8ac8-f295803f607d, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:50 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-de5f96f5-9ce5-4807-ac5a-180b10903546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.109s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-quobyte-902b41d2-ebe0-4bb5-aa59-fb69a649c566" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:51 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-795c6113-946a-4b07-ac65-35f60f996512 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created volume successfully. Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[49351fe2-a5d3-4493-a67e-320d399420f3]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-902b41d2-ebe0-4bb5-aa59-fb69a649c566" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-quobyte-de5f96f5-9ce5-4807-ac5a-180b10903546" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-de5f96f5-9ce5-4807-ac5a-180b10903546" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Deleting offline snapshot de5f96f5-9ce5-4807-ac5a-180b10903546 of volume 902b41d2-ebe0-4bb5-aa59-fb69a649c566 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] snapshot_file for this snap is: volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ef338f-057f-4b96-974f-856cf4923c52]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:51 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 Apr 24 01:21:51 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:51 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 Apr 24 01:21:51 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:51 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5" returned: 0 in 0.613s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:21:51 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546" returned: 0 in 0.552s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b22c6ae-fb87-45fb-b312-cd2b3dc1ca48]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f308b6-dc38-4fbd-9b10-ba9b2f44f969]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-af7f0b73-36f0-435e-a257-0e3884270fce-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-af7f0b73-36f0-435e-a257-0e3884270fce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:51 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 Apr 24 01:21:51 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-quobyte-af7f0b73-36f0-435e-a257-0e3884270fce" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:51 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 Apr 24 01:21:51 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-af7f0b73-36f0-435e-a257-0e3884270fce" acquired by "delete_volume" :: waited 0.014s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[28042ab3-af4c-4e29-a557-58e7e244e6d4]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:51 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:51 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce Apr 24 01:21:51 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:52 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566" returned: 0 in 0.553s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:52 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" returned: 0 in 0.588s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:52 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 Apr 24 01:21:52 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:52 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d Apr 24 01:21:52 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:52 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce" returned: 0 in 0.595s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:52 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce Apr 24 01:21:52 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:52 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546" returned: 0 in 0.560s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:52 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546 Apr 24 01:21:52 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:52 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-af7f0b73-36f0-435e-a257-0e3884270fce" returned: 0 in 0.566s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:52 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-af7f0b73-36f0-435e-a257-0e3884270fce" released by "delete_volume" :: held 1.209s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:53 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created reservations ['fcf8e6c2-c909-4671-b1c7-5effccad43bc', '0d692fcf-20ce-4b46-aed8-f5eda0386472', '262f1a34-62bb-4a31-9491-cb35f305aa22', '1c6c6e56-eeb1-4865-ad1f-7b5c9291a514'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:53 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:53 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:53 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:53 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-67b5bc92-022b-42dd-afa3-188cab7a804f-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-67b5bc92-022b-42dd-afa3-188cab7a804f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-quobyte-67b5bc92-022b-42dd-afa3-188cab7a804f" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-67b5bc92-022b-42dd-afa3-188cab7a804f" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:54 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.010s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5e4379-785b-4198-8d6e-23e346d44fe9]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:54 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Deleted volume successfully. Apr 24 01:21:54 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566.de5f96f5-9ce5-4807-ac5a-180b10903546" returned: 0 in 1.565s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d741a658-7d87-43fa-a0ca-1a01a42a90a8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-af7f0b73-36f0-435e-a257-0e3884270fce-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-de5f96f5-9ce5-4807-ac5a-180b10903546" released by "_delete_snapshot" :: held 3.414s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-902b41d2-ebe0-4bb5-aa59-fb69a649c566" released by "delete_snapshot" :: held 3.440s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:54 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f Apr 24 01:21:54 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created reservations ['b671ad83-0f7f-4e12-bb04-70c294ae1f4b', '68e644a2-0481-4b70-8c0c-e455191e34bd', '95128104-0b90-47c3-a78e-0fc9d022a699', '412889ab-bb65-4eb2-9456-aeb93252c18b'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:54 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Delete snapshot completed successfully. Apr 24 01:21:54 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-528232c8-7731-4634-947b-d52235b6fe51 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-de5f96f5-9ce5-4807-ac5a-180b10903546-delete_snapshot" released by "delete_snapshot" :: held 3.703s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-902b41d2-ebe0-4bb5-aa59-fb69a649c566-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-902b41d2-ebe0-4bb5-aa59-fb69a649c566-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "cinder-quobyte-902b41d2-ebe0-4bb5-aa59-fb69a649c566" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:55 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-902b41d2-ebe0-4bb5-aa59-fb69a649c566" acquired by "delete_volume" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:55 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85b36cb-1ce4-405f-a6f6-f82dfa3ac64b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:55 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f" returned: 0 in 1.227s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:55 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:55 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f Apr 24 01:21:55 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:55 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 Apr 24 01:21:55 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:56 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566" returned: 0 in 1.033s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:56 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:56 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566 Apr 24 01:21:56 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:56 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-67b5bc92-022b-42dd-afa3-188cab7a804f" returned: 0 in 1.457s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-67b5bc92-022b-42dd-afa3-188cab7a804f" released by "delete_volume" :: held 2.834s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created reservations ['a11ab416-308e-4059-b31c-81bd0c19b408', 'f5d36d9e-31e7-4ee6-95eb-edb3c4a425ad', 'e80f6937-7522-4287-a6b3-a83c51b71781', '631986af-da35-4c8c-abd3-1746dcac6e14'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:57 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:57 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:57 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-3ee56cf6-b72b-485b-bc61-df633cf99a01-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-902b41d2-ebe0-4bb5-aa59-fb69a649c566" returned: 0 in 1.232s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-quobyte-902b41d2-ebe0-4bb5-aa59-fb69a649c566" released by "delete_volume" :: held 2.410s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-3ee56cf6-b72b-485b-bc61-df633cf99a01-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-quobyte-3ee56cf6-b72b-485b-bc61-df633cf99a01" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Created reservations ['3b417243-7ad7-40c9-88ed-f0190e57b9d4', '837666aa-2b51-4134-8e51-5bae192994ba', '4420056c-8420-478c-9d13-ee383d51d24e', 'd9ffe38c-9127-4545-85be-4f7463630a92'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-3ee56cf6-b72b-485b-bc61-df633cf99a01" acquired by "delete_volume" :: waited 0.025s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:21:57 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" returned: 0 in 5.563s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff46e34e-509e-49a9-9034-35cf7ca02ffb]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d6bcd-dc18-40bf-974c-32bfa8d16a6c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:57 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:57 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 Apr 24 01:21:57 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:57 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 Apr 24 01:21:57 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:58 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:58 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:58 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.758s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:58 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Deleted volume successfully. Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-fab7fb15-95be-463d-a4dc-26a81ad24eb2 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-67b5bc92-022b-42dd-afa3-188cab7a804f-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:58 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01" returned: 0 in 0.589s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:58 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01 Apr 24 01:21:58 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:58 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.455s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:58 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Deleted volume successfully. Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d1708a5f-49e8-4dd4-88b5-9e3583520b50 tempest-CreateVolumesFromSnapshotTest-1719035715 None] Lock "cinder-902b41d2-ebe0-4bb5-aa59-fb69a649c566-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:58 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" returned: 0 in 0.766s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:21:58 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Converted 1024.00 MB image at 184.04 MB/s Apr 24 01:21:58 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d is being set with open permissions: ugo+rw Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:58 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d Apr 24 01:21:58 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:58 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:58 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-3ee56cf6-b72b-485b-bc61-df633cf99a01" returned: 0 in 0.554s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-3ee56cf6-b72b-485b-bc61-df633cf99a01" released by "delete_volume" :: held 1.192s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:SELECT=138,cinder:UPDATE=209,cinder:DELETE=18,cinder:INSERT=56 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created reservations ['9155daa1-6620-4a47-892a-c84ab15822ce', '8e1e0d49-ccc8-4e61-970b-143b57e9a541', '301a7965-798e-4e1c-ba48-9ae6d492627f', 'a8e10a0e-6edb-4390-87a9-57c0245bf0c5'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:59 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" returned: 0 in 0.531s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" released by "_copy_volume_from_snapshot" :: held 8.207s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:59 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:21:59 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-a6865617-711b-4eac-9dcd-ea0bb47b89f5-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" released by "_create_volume_from_snapshot" :: held 8.274s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.313s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.127s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:21:59 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Cloning volume 019732bf-7692-4e2f-b684-dab769edce66 to volume c943347f-d376-487a-b92d-42989a1916c3 Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:UPDATE=180,cinder:SELECT=147,cinder:INSERT=32,cinder:DELETE=20 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699d55df-e36f-402f-b6ee-571a3c539cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d', 'volume_size': 1, 'snapshot_id': 'a6865617-711b-4eac-9dcd-ea0bb47b89f5'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210f5c21-ed05-4b99-9ea2-c3b37ff0dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Creating offline snapshot b9479c2f-d89e-4bec-af81-3cf55853b95f of volume 019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:21:59 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Volume volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d (8d1d4eb0-f27d-4db2-8ac8-f295803f607d): created successfully Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210f5c21-ed05-4b99-9ea2-c3b37ff0dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Flow 'volume_create_manager' (06d4ebf2-ef98-44fd-a076-de381abc6578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ddb095-47c8-4a8b-9e35-ce4de30dd60c]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:21:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e0a7daea-5d8a-4f11-b22a-43b6a1ba6f9e tempest-SnapshotDependencyTests-2093157742 None] Created volume successfully. Apr 24 01:21:59 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 Apr 24 01:21:59 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:21:59 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.583s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:21:59 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Deleted volume successfully. Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-9d7715bc-0322-4396-a223-481a0eea75d8 tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-3ee56cf6-b72b-485b-bc61-df633cf99a01-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:21:59 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-f9257898-f30f-4352-838d-8710b0ba0f56-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-f9257898-f30f-4352-838d-8710b0ba0f56-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-quobyte-f9257898-f30f-4352-838d-8710b0ba0f56" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:00 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66" returned: 0 in 0.756s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-f9257898-f30f-4352-838d-8710b0ba0f56" acquired by "delete_volume" :: waited 0.047s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:00 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f 1G Apr 24 01:22:00 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[effca128-7977-49c0-9089-573c3db2c359]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-a6865617-711b-4eac-9dcd-ea0bb47b89f5-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-a6865617-711b-4eac-9dcd-ea0bb47b89f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-quobyte-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-quobyte-a6865617-711b-4eac-9dcd-ea0bb47b89f5" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-a6865617-711b-4eac-9dcd-ea0bb47b89f5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Deleting offline snapshot a6865617-711b-4eac-9dcd-ea0bb47b89f5 of volume c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:22:00 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 Apr 24 01:22:00 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] snapshot_file for this snap is: volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[333372f2-2602-4167-b508-e2cb8e527fcc]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:00 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 Apr 24 01:22:00 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:00 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56" returned: 0 in 0.605s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:00 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f 1G" returned: 0 in 0.699s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-019732bf-7692-4e2f-b684-dab769edce66 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:00 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56 Apr 24 01:22:00 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:00 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-019732bf-7692-4e2f-b684-dab769edce66 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f Apr 24 01:22:00 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:00 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5" returned: 0 in 0.566s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c93fd-23c8-4507-9419-b19270d3d864]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:00 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:01 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 Apr 24 01:22:01 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:01 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f9257898-f30f-4352-838d-8710b0ba0f56" returned: 0 in 0.495s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-f9257898-f30f-4352-838d-8710b0ba0f56" released by "delete_volume" :: held 1.163s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:01 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-019732bf-7692-4e2f-b684-dab769edce66 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f" returned: 0 in 0.512s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:01 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f is being set with open permissions: ugo+rw Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:01 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f Apr 24 01:22:01 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created reservations ['a08d997e-7c50-4b5c-b3ba-c9b37a2ce8ee', '25d71dfe-7bf4-4173-9f1b-e995cef65694', '0334367b-742a-42da-9d00-8a70343755fb', 'fd08a8fc-d54c-462c-aded-682de256f299'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:01 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:01 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:01 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" returned: 0 in 0.637s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:01 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 Apr 24 01:22:01 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:01 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f" returned: 0 in 0.448s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:01 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.info Apr 24 01:22:01 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:01 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.548s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:01 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:01 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Deleted volume successfully. Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-6c36e058-0944-48f3-9562-2ffc345e011a tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-f9257898-f30f-4352-838d-8710b0ba0f56-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:02 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5" returned: 0 in 0.596s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:02 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5 Apr 24 01:22:02 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-8b6cc8cd-af72-47ea-8856-b1d177eca4b9-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-8b6cc8cd-af72-47ea-8856-b1d177eca4b9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:02 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.info" returned: 0 in 0.568s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:02 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.info is being set with open permissions: ugo+rw Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:02 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.info Apr 24 01:22:02 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-quobyte-8b6cc8cd-af72-47ea-8856-b1d177eca4b9" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-8b6cc8cd-af72-47ea-8856-b1d177eca4b9" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ece980b-ab4b-4ca5-99b6-a69c4b3e180e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:02 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 Apr 24 01:22:02 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:02 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3.a6865617-711b-4eac-9dcd-ea0bb47b89f5" returned: 0 in 0.500s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-a6865617-711b-4eac-9dcd-ea0bb47b89f5" released by "_delete_snapshot" :: held 2.409s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" released by "delete_snapshot" :: held 2.433s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Created reservations ['0e524914-8f35-4ad6-b6cd-71c8ed73b66d', '23315e47-2507-4dd8-83f8-9666ecb5280c', 'c180fac8-5d69-495b-8d00-6e3dcc9959f2', '5e5443c4-db8a-4bb5-bebd-4bd7c4a23677'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:02 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Delete snapshot completed successfully. Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-262ef066-db73-485d-9c32-2f00c0f58737 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-a6865617-711b-4eac-9dcd-ea0bb47b89f5-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:02 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.info" returned: 0 in 0.506s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-c943347f-d376-487a-b92d-42989a1916c3" by "_copy_volume_from_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-c943347f-d376-487a-b92d-42989a1916c3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] snapshot: b9479c2f-d89e-4bec-af81-3cf55853b95f, volume: c943347f-d376-487a-b92d-42989a1916c3, {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c0e62b-8409-455e-ba2c-ad193a5b0112]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:02 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:02 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f Apr 24 01:22:02 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:03 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9" returned: 0 in 0.591s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:03 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9 Apr 24 01:22:03 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:03 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-quobyte-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f" returned: 0 in 0.597s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-019732bf-7692-4e2f-b684-dab769edce66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Creating direct copy from snapshot {{(pid=81925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e9fb9-9dab-4a90-9ee4-0e956fe438fe]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:03 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f282c-7bd0-408e-a424-4c0baefb400b]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8b6cc8cd-af72-47ea-8856-b1d177eca4b9" returned: 0 in 0.562s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-8b6cc8cd-af72-47ea-8856-b1d177eca4b9" released by "delete_volume" :: held 1.196s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created reservations ['b382642b-faeb-4763-9e1d-4355e8d29c84', '11f8413f-6a9b-4cd7-ac0d-4f8d25cc2bc0', 'e526b309-a30b-4444-8581-ff0e6b9c43e4', '6812e269-66bf-4eea-9d3e-0c8156020b9f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:03 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 Apr 24 01:22:03 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:03 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 Apr 24 01:22:03 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:03 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:03 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:03 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:04 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66" returned: 0 in 0.540s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.utils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Path /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 not found in is_blk_device check {{(pid=81925) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:04 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 Apr 24 01:22:04 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:04 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" returned: 0 in 0.573s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:04 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3 Apr 24 01:22:04 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:04 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.473s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:04 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Deleted volume successfully. Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-b3bcdc70-73fb-4a8c-b99c-eb732ed7959f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-8b6cc8cd-af72-47ea-8856-b1d177eca4b9-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-a5f0860e-58d9-45c2-8a52-f00c4442b79f-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-a5f0860e-58d9-45c2-8a52-f00c4442b79f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "cinder-quobyte-a5f0860e-58d9-45c2-8a52-f00c4442b79f" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-a5f0860e-58d9-45c2-8a52-f00c4442b79f" acquired by "delete_volume" :: waited 0.017s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe4c75-3ea4-4f20-9fba-eb781e3546ae]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:04 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" returned: 0 in 0.595s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:04 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f Apr 24 01:22:04 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3" released by "delete_volume" :: held 1.241s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:04 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Created reservations ['85652c30-a916-44bc-8805-04c12d77d231', 'b2f3bbf7-fc9e-491b-a326-55ead28fae34', 'd5ee91aa-7171-4411-acd7-18b48f6cf2ca', 'b1fd9947-1bf0-405b-b07f-82cbf6420c7a'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:05 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:05 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-8d1d4eb0-f27d-4db2-8ac8-f295803f607d-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-8d1d4eb0-f27d-4db2-8ac8-f295803f607d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "cinder-quobyte-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:05 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f" returned: 0 in 1.243s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:05 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f Apr 24 01:22:05 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:05 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" acquired by "delete_volume" :: waited 0.055s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:06 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be629aa-f6ae-47bf-8044-4bc913f0322d]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:06 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d Apr 24 01:22:06 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:06 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:06 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.642s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:06 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:06 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Deleted volume successfully. Apr 24 01:22:06 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1b3f220f-0447-47e6-9aa3-d9ff50b767e5 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-c3e97c40-1ab3-4260-9e66-8cd23a7f95d3-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:07 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" returned: 0 in 1.080s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:07 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-a5f0860e-58d9-45c2-8a52-f00c4442b79f" returned: 0 in 1.223s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-quobyte-a5f0860e-58d9-45c2-8a52-f00c4442b79f" released by "delete_volume" :: held 2.535s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:07 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d Apr 24 01:22:07 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Created reservations ['e0dadc4d-4e56-498a-8568-951884df062d', '940d9cdc-efab-4ea0-9f34-9f12280bf1e5', '0e8a5cfc-a0b8-46c1-8e2d-13b75d17f459', 'd044ec07-f3eb-4aeb-95d9-86ae67e858d4'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:07 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:07 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:07 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" returned: 0 in 0.787s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:07 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-quobyte-8d1d4eb0-f27d-4db2-8ac8-f295803f607d" released by "delete_volume" :: held 1.971s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Created reservations ['ba288d4e-3fe7-4ca6-ad56-c377f3bbec5e', '848ee017-7937-4ccd-bc2d-97b16a10925d', 'af1ee6a1-d978-4179-8bc2-acaf489d5893', 'e577c8fa-0ea7-49cd-8847-a556a499ed25'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:08 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:08 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:08 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.117s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:08 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Deleted volume successfully. Apr 24 01:22:08 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-e3fbebf1-95bf-4b43-9b2d-16cf3809c19f tempest-CreateVolumesFromSourceVolumeTest-681792861 None] Lock "cinder-a5f0860e-58d9-45c2-8a52-f00c4442b79f-delete_volume" released by "delete_volume" :: held 3.982s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:09 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:09 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 1.507s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:09 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:09 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Deleted volume successfully. Apr 24 01:22:09 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-87942852-630d-4ba6-a7d0-afff91dbd261 tempest-SnapshotDependencyTests-2093157742 None] Lock "cinder-8d1d4eb0-f27d-4db2-8ac8-f295803f607d-delete_volume" released by "delete_volume" :: held 3.925s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:10 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3" returned: 0 in 6.238s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:10 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[522e3c62-4dd2-4f63-94cf-334358c92d90]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:10 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:10 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 Apr 24 01:22:10 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:11 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66" returned: 0 in 0.806s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG cinder.image.image_utils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Image conversion details: src /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 {{(pid=81925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 01:22:11 devstack cinder-volume[81925]: INFO cinder.image.image_utils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Converted 1024.00 MB image at 164.12 MB/s Apr 24 01:22:11 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 is being set with open permissions: ugo+rw Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:11 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 Apr 24 01:22:11 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:11 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3" returned: 0 in 0.555s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-c943347f-d376-487a-b92d-42989a1916c3" released by "_copy_volume_from_snapshot" :: held 8.845s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-b9479c2f-d89e-4bec-af81-3cf55853b95f" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-b9479c2f-d89e-4bec-af81-3cf55853b95f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Deleting offline snapshot b9479c2f-d89e-4bec-af81-3cf55853b95f of volume 019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] snapshot_file for this snap is: volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_service.periodic_task [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81925) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db9431d-b2bd-487d-84c1-e8ac0086bf02]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:11 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:11 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:11 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:12 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f Apr 24 01:22:12 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Flow 'volume_create_manager' (51473df3-4473-4ee4-aa0f-f0b29dfa549b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba22864-4ee6-4b79-a640-e86c98ad4a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba22864-4ee6-4b79-a640-e86c98ad4a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7caddc7-40de-4180-9493-5a5b1e3578ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d32ff3a8b9c47b2bdcb991eb418a7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:22:12Z,use_quota=True,user_id='5171c344ba164f47ae0927a81b8afcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e909811-f854-47c6-8cc4-af884c257834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e909811-f854-47c6-8cc4-af884c257834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c582dae2-da91-4191-9559-c6945e816a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c582dae2-da91-4191-9559-c6945e816a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7caddc7-40de-4180-9493-5a5b1e3578ca', 'volume_name': 'volume-e7caddc7-40de-4180-9493-5a5b1e3578ca', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1ca9db-09d3-4b28-ad2a-e197d0750ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1ca9db-09d3-4b28-ad2a-e197d0750ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40796c94-8550-49a4-bba1-3058ce4debe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:12 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Volume e7caddc7-40de-4180-9493-5a5b1e3578ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7caddc7-40de-4180-9493-5a5b1e3578ca', 'volume_size': 1} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:12 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.718s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-dd34990b-44ef-4120-af5e-5ca09cab3f7c None None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:12 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f" returned: 0 in 0.981s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-019732bf-7692-4e2f-b684-dab769edce66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c96cbc3-51e9-493c-b679-4be67dcb5d69]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:12 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:12 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 Apr 24 01:22:12 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:13 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66" returned: 0 in 0.648s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:13 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:13 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f Apr 24 01:22:13 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:14 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f" returned: 0 in 0.598s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:14 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f Apr 24 01:22:14 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:14 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66.b9479c2f-d89e-4bec-af81-3cf55853b95f" returned: 0 in 0.532s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-b9479c2f-d89e-4bec-af81-3cf55853b95f" released by "_delete_snapshot" :: held 2.897s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.502s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.249s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7caddc7-40de-4180-9493-5a5b1e3578ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d32ff3a8b9c47b2bdcb991eb418a7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:22:12Z,use_quota=True,user_id='5171c344ba164f47ae0927a81b8afcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Creating volume e7caddc7-40de-4180-9493-5a5b1e3578ca {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:22:14 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b39607-4f42-4ed0-8207-684229fd1f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c943347f-d376-487a-b92d-42989a1916c3', 'volume_size': 1, 'source_volid': '019732bf-7692-4e2f-b684-dab769edce66', 'source_volstatus': 'available'}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:14 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca 1073741824 Apr 24 01:22:14 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9930c4d1-96fc-422a-ad42-d0d2b8528ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:14 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Volume volume-c943347f-d376-487a-b92d-42989a1916c3 (c943347f-d376-487a-b92d-42989a1916c3): created successfully Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9930c4d1-96fc-422a-ad42-d0d2b8528ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:14 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Flow 'volume_create_manager' (9752cc3d-3eb5-4b7b-af80-325c10eabf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:22:14 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-0eb2db49-0f2d-4008-af52-7a4a07d25d71 tempest-VolumeDependencyTests-1497362426 None] Created volume successfully. Apr 24 01:22:15 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca 1073741824" returned: 0 in 0.704s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:15 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca Apr 24 01:22:15 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-019732bf-7692-4e2f-b684-dab769edce66-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-019732bf-7692-4e2f-b684-dab769edce66-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-019732bf-7692-4e2f-b684-dab769edce66" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:15 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-019732bf-7692-4e2f-b684-dab769edce66" acquired by "delete_volume" :: waited 0.013s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:15 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cdb014-c268-4aa6-86cb-502cdd224537]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:15 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:15 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 Apr 24 01:22:15 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:15 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca" returned: 0 in 0.542s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40796c94-8550-49a4-bba1-3058ce4debe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7caddc7-40de-4180-9493-5a5b1e3578ca', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2907f629-d876-4c2a-84bf-0fb905e9dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:16 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Volume volume-e7caddc7-40de-4180-9493-5a5b1e3578ca (e7caddc7-40de-4180-9493-5a5b1e3578ca): created successfully Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2907f629-d876-4c2a-84bf-0fb905e9dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Flow 'volume_create_manager' (51473df3-4473-4ee4-aa0f-f0b29dfa549b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:22:16 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1e85495f-e5a8-4bd5-a6ba-1a9e96d86af4 tempest-CinderUnicodeTest-263713045 None] Created volume successfully. Apr 24 01:22:16 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66" returned: 0 in 0.648s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:16 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66 Apr 24 01:22:16 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:16 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-019732bf-7692-4e2f-b684-dab769edce66" returned: 0 in 0.500s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-019732bf-7692-4e2f-b684-dab769edce66" released by "delete_volume" :: held 1.217s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:16 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Created reservations ['8ce6e80d-9586-4ffc-99e1-a2fa6e0b19c3', 'df8dc085-62fd-4a9b-9c9d-ac84f2df3e3b', '18d9616e-7c3c-4518-8d34-628a9b4abe13', 'ccac92f3-695f-411b-9173-fb19ad548fbf'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:17 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:17 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Flow 'volume_create_manager' (741b97d3-4836-40ca-b91a-97c4ac694146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b33227-d63b-43f0-9d36-f93ec2865348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b33227-d63b-43f0-9d36-f93ec2865348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:22:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1604456593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fd081f-0133-4026-8ac5-84226b2aaea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d32ff3a8b9c47b2bdcb991eb418a7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:22:17Z,use_quota=True,user_id='5171c344ba164f47ae0927a81b8afcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2880d6-2ac4-40f1-8a72-17e4d5cc2a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2880d6-2ac4-40f1-8a72-17e4d5cc2a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8516ffa-4317-454c-9912-4a5b2e97e9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8516ffa-4317-454c-9912-4a5b2e97e9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fd081f-0133-4026-8ac5-84226b2aaea2', 'volume_name': 'volume-f2fd081f-0133-4026-8ac5-84226b2aaea2', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acffc5c-7fb0-4ac5-9d2e-0e9e0cdb0f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acffc5c-7fb0-4ac5-9d2e-0e9e0cdb0f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7911369c-5d24-4325-b89e-308968e84210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:17 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Volume f2fd081f-0133-4026-8ac5-84226b2aaea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fd081f-0133-4026-8ac5-84226b2aaea2', 'volume_size': 1} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-23T23:22:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1604456593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fd081f-0133-4026-8ac5-84226b2aaea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d32ff3a8b9c47b2bdcb991eb418a7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-23T23:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-23T23:22:17Z,use_quota=True,user_id='5171c344ba164f47ae0927a81b8afcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ae743c-fdf7-4763-b845-7eaade2254bf),volume_type_id=35ae743c-fdf7-4763-b845-7eaade2254bf)}" {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Creating volume f2fd081f-0133-4026-8ac5-84226b2aaea2 {{(pid=81925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Selected osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b as target Quobyte volume. {{(pid=81925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 01:22:17 devstack cinder-volume[81925]: INFO cinder.volume.drivers.remotefs [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] casted to osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 1073741824 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:17 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 1073741824 Apr 24 01:22:17 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:17 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.531s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:17 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Deleted volume successfully. Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-1041b03b-fdd5-4f36-9923-0e541a979193 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-019732bf-7692-4e2f-b684-dab769edce66-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-c943347f-d376-487a-b92d-42989a1916c3-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-c943347f-d376-487a-b92d-42989a1916c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-c943347f-d376-487a-b92d-42989a1916c3" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:17 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-c943347f-d376-487a-b92d-42989a1916c3" acquired by "delete_volume" :: waited 0.020s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:17 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 1073741824" returned: 0 in 0.749s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5664ac-726e-4be7-93aa-ddaecfbc6d41]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:18 devstack sudo[91349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 Apr 24 01:22:18 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:18 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 Apr 24 01:22:18 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:18 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2" returned: 0 in 0.480s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'} {{(pid=81925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7911369c-5d24-4325-b89e-308968e84210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fd081f-0133-4026-8ac5-84226b2aaea2', 'volume_size': 1}' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b683d719-d72a-4b65-9e6d-fb9914015271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 01:22:18 devstack cinder-volume[81925]: INFO cinder.volume.flows.manager.create_volume [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Volume volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 (f2fd081f-0133-4026-8ac5-84226b2aaea2): created successfully Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b683d719-d72a-4b65-9e6d-fb9914015271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81925) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Flow 'volume_create_manager' (741b97d3-4836-40ca-b91a-97c4ac694146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81925) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 01:22:18 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-dbaf686a-0de4-46fe-955f-22b809b14ddb tempest-CinderUnicodeTest-263713045 None] Created volume successfully. Apr 24 01:22:18 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3" returned: 0 in 0.647s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:18 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:18 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3 Apr 24 01:22:18 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:19 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-c943347f-d376-487a-b92d-42989a1916c3" returned: 0 in 0.500s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-c943347f-d376-487a-b92d-42989a1916c3" released by "delete_volume" :: held 1.218s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Created reservations ['19b0aa8f-7d12-4b94-b1a9-0eb2f02b4dd0', 'c2417e3a-c176-4415-80ad-bfd4187101e5', '0d157ff1-aaa4-4849-b42d-19f3520c4f28', '06f73672-7f4e-4062-b87c-05281081ad4b'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:19 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:19 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Creating offline snapshot 916fb03d-e930-42d4-a026-1b106fabff37 of volume f2fd081f-0133-4026-8ac5-84226b2aaea2 {{(pid=81925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad633ca6-9362-40ce-99e6-cbeaef604c6e]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:19 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 Apr 24 01:22:19 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:19 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.438s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:19 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Deleted volume successfully. Apr 24 01:22:19 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-a30e86c2-6ab0-4371-ac39-14936712ebe4 tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-c943347f-d376-487a-b92d-42989a1916c3-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:20 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2" returned: 0 in 0.526s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 1G {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:20 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 1G Apr 24 01:22:20 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-d68fd18e-59b5-4271-9417-3d94b1e075c6-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-d68fd18e-59b5-4271-9417-3d94b1e075c6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "cinder-quobyte-d68fd18e-59b5-4271-9417-3d94b1e075c6" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-d68fd18e-59b5-4271-9417-3d94b1e075c6" acquired by "delete_volume" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7979c7-8a64-47e9-a7b4-6bd523f8a6a8]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:20 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 Apr 24 01:22:20 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:20 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 1G" returned: 0 in 0.652s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:20 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 Apr 24 01:22:20 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:20 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6" returned: 0 in 0.533s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:20 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:20 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6 Apr 24 01:22:20 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:21 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 -F qcow2 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37" returned: 0 in 0.496s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:21 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 is being set with open permissions: ugo+rw Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:21 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 Apr 24 01:22:21 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:21 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-d68fd18e-59b5-4271-9417-3d94b1e075c6" returned: 0 in 0.434s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-quobyte-d68fd18e-59b5-4271-9417-3d94b1e075c6" released by "delete_volume" :: held 1.005s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Created reservations ['62eb6e94-b6aa-41f4-8163-2208c3950fc3', '84a0815f-a23c-40a4-8a97-f41480618a58', '6521d366-7ff7-4adb-bff3-d256a7e6c538', 'f657bade-80de-4b5f-911d-7eb88c2d29ac'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:21 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:21 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:21 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37" returned: 0 in 0.458s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:21 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.info Apr 24 01:22:21 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:21 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.459s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:21 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Deleted volume successfully. Apr 24 01:22:21 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-761487f8-e9f8-4286-8484-fafab9e7ec5d tempest-VolumeDependencyTests-1497362426 None] Lock "cinder-d68fd18e-59b5-4271-9417-3d94b1e075c6-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:22 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.info" returned: 0 in 0.467s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:22 devstack cinder-volume[81925]: WARNING cinder.volume.drivers.remotefs [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.info is being set with open permissions: ugo+rw Apr 24 01:22:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.info {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:22 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.info Apr 24 01:22:22 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:22 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.info" returned: 0 in 0.496s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:22 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.178s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:22 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-419f8d2a-be00-4600-9cbc-9b48dc1aaace tempest-CinderUnicodeTest-263713045 None] Create snapshot completed successfully Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Acquiring lock "cinder-916fb03d-e930-42d4-a026-1b106fabff37-delete_snapshot" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-916fb03d-e930-42d4-a026-1b106fabff37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Acquiring lock "cinder-quobyte-f2fd081f-0133-4026-8ac5-84226b2aaea2" by "delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-quobyte-f2fd081f-0133-4026-8ac5-84226b2aaea2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Acquiring lock "cinder-quobyte-916fb03d-e930-42d4-a026-1b106fabff37" by "_delete_snapshot" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-quobyte-916fb03d-e930-42d4-a026-1b106fabff37" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Deleting offline snapshot 916fb03d-e930-42d4-a026-1b106fabff37 of volume f2fd081f-0133-4026-8ac5-84226b2aaea2 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] snapshot_file for this snap is: volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 {{(pid=81925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5476e76b-e1ab-44f9-afbd-537526d42e12]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:23 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:23 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 Apr 24 01:22:23 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:24 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37" returned: 0 in 0.585s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:24 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.remotefs [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2fd081f-0133-4026-8ac5-84226b2aaea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 01:22:24 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c591b3-35a0-4b5f-b5ec-61f10210ac2f]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:24 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 Apr 24 01:22:24 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:24 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2" returned: 0 in 0.527s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:24 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:24 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 Apr 24 01:22:24 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:25 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37" returned: 0 in 0.583s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:25 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:25 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37 Apr 24 01:22:25 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:25 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2.916fb03d-e930-42d4-a026-1b106fabff37" returned: 0 in 0.470s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-quobyte-916fb03d-e930-42d4-a026-1b106fabff37" released by "_delete_snapshot" :: held 2.272s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-quobyte-f2fd081f-0133-4026-8ac5-84226b2aaea2" released by "delete_snapshot" :: held 2.297s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Created reservations ['36cf8491-255a-4eb3-863c-a8cef13d0f3b', '9400f7ca-8234-4792-9f44-d81e615ab055', '432aaa5f-223e-45d8-bf1a-c39aecbecea1', 'b4eb0950-c30c-48ca-a72a-d9280f76f89f'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:26 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Delete snapshot completed successfully. Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c7b8c40-2956-44d3-a5d8-37afa56eaef7 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-916fb03d-e930-42d4-a026-1b106fabff37-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Acquiring lock "cinder-f2fd081f-0133-4026-8ac5-84226b2aaea2-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Lock "cinder-f2fd081f-0133-4026-8ac5-84226b2aaea2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Acquiring lock "cinder-quobyte-f2fd081f-0133-4026-8ac5-84226b2aaea2" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:26 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Lock "cinder-quobyte-f2fd081f-0133-4026-8ac5-84226b2aaea2" acquired by "delete_volume" :: waited 0.015s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:27 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[70154ccc-800f-41df-a452-248ee36e10fa]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:27 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 Apr 24 01:22:27 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:27 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2" returned: 0 in 0.520s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:27 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2 Apr 24 01:22:27 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:27 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:27 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-f2fd081f-0133-4026-8ac5-84226b2aaea2" returned: 0 in 0.427s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:27 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Lock "cinder-quobyte-f2fd081f-0133-4026-8ac5-84226b2aaea2" released by "delete_volume" :: held 1.009s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Created reservations ['85db6254-78ba-4535-96a5-7e0a47449da6', 'caa544de-55fe-4030-b7af-b6f595bb3fd8', 'd7968dbe-ba6e-4937-882b-15ecf48ab531', 'c054d7eb-3478-495b-a3ba-f98360b9fb74'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:28 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:28 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:28 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.459s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:28 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Deleted volume successfully. Apr 24 01:22:28 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-d70ff220-29f8-4e19-9788-a4b27be240bb tempest-CinderUnicodeTest-263713045 None] Lock "cinder-f2fd081f-0133-4026-8ac5-84226b2aaea2-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Acquiring lock "cinder-e7caddc7-40de-4180-9493-5a5b1e3578ca-delete_volume" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-e7caddc7-40de-4180-9493-5a5b1e3578ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Acquiring lock "cinder-quobyte-e7caddc7-40de-4180-9493-5a5b1e3578ca" by "delete_volume" {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 01:22:29 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-quobyte-e7caddc7-40de-4180-9493-5a5b1e3578ca" acquired by "delete_volume" :: waited 0.016s {{(pid=81925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 01:22:29 devstack cinder-volume[81925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8e3fed-5f2a-4384-95fa-2859db8724b9]: (4, 'qcow2') {{(pid=82536) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 01:22:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:29 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca Apr 24 01:22:29 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:29 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca" returned: 0 in 0.511s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:29 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:29 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca Apr 24 01:22:29 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:30 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6/volume-e7caddc7-40de-4180-9493-5a5b1e3578ca" returned: 0 in 0.478s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-quobyte-e7caddc7-40de-4180-9493-5a5b1e3578ca" released by "delete_volume" :: held 1.037s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG cinder.quota [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Created reservations ['9cf0d447-26ea-4eee-a57e-87ea41912c8c', '5306001e-9c24-4fc4-9deb-a02b18e1b0af', '1d2aa1d5-a914-4dd8-87fe-b3f00eed83e8', 'ec2ed99e-b0a9-4b91-9dd5-338cb18973b3'] {{(pid=81925) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b': None} {{(pid=81925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG cinder.volume.drivers.quobyte [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0557ba7-475c-4708-9a37-a44a7fc51d9b'] {{(pid=81925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.lockutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81925) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 01:22:30 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6 Apr 24 01:22:30 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 01:22:30 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG oslo_concurrency.processutils [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/743ee3719437c963d0e1ac1916e3fcd6" returned: 0 in 0.431s {{(pid=81925) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG cinder.manager [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Notifying Schedulers of capabilities ... {{(pid=81925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 01:22:30 devstack cinder-volume[81925]: INFO cinder.volume.manager [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Deleted volume successfully. Apr 24 01:22:30 devstack cinder-volume[81925]: DEBUG cinder.coordination [None req-2c07031c-6ee6-4782-957b-2cbae9ba54a2 tempest-CinderUnicodeTest-263713045 None] Lock "cinder-e7caddc7-40de-4180-9493-5a5b1e3578ca-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=81925) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 01:22:40 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:INSERT=41,cinder:UPDATE=115,cinder:SELECT=75,cinder:DELETE=7 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 01:22:40 devstack cinder-volume[81925]: DEBUG dbcounter [-] [81925] Writing DB stats cinder:DELETE=9,cinder:SELECT=70,cinder:INSERT=16,cinder:UPDATE=101 {{(pid=81925) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}